-- Logs begin at Mon 2022-07-18 13:36:46 UTC, end at Mon 2022-07-18 14:41:21 UTC. -- Jul 18 14:09:57.322062 dv-cinder-797608-58-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 14:09:57.331593 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 14:09:57 2022] *** Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: nodename: dv-cinder-797608-58-iscsi Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: machine: x86_64 Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: clock source: unix Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: pcre jit disabled Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: detected number of CPU cores: 4 Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: current working directory: / Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: detected binary path: /usr/bin/uwsgi-core Jul 18 14:09:57.333693 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: your processes number limit is 47680 Jul 18 14:09:57.334432 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: your memory page size is 4096 bytes Jul 18 14:09:57.334432 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: detected max file descriptor number: 2048 Jul 18 14:09:57.334432 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: lock engine: pthread robust mutexes Jul 18 14:09:57.334432 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: thunder lock: enabled Jul 18 14:09:57.334432 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 14:09:57.334432 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 14:09:57.373568 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: Python main interpreter initialized at 0x55822dfc49c0 Jul 18 14:09:57.373568 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: python threads support enabled Jul 18 14:09:57.373568 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: your server socket listen backlog is limited to 100 connections Jul 18 14:09:57.373568 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: your mercy for graceful operations on workers is 90 seconds Jul 18 14:09:57.374024 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 14:09:57.374024 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: *** Operational MODE: preforking *** Jul 18 14:09:57.374310 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: *** uWSGI is running in multiple interpreter mode *** Jul 18 14:09:57.374310 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: spawned uWSGI master process (pid: 103206) Jul 18 14:09:57.374538 dv-cinder-797608-58-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 14:09:57.375161 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: spawned uWSGI worker 1 (pid: 103207, cores: 1) Jul 18 14:09:57.376121 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: spawned uWSGI worker 2 (pid: 103208, cores: 1) Jul 18 14:09:57.376121 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 14:09:58.038208 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 14:09:58.038792 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 14:09:59.134270 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:09:59.134270 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: from cryptography.utils import int_from_bytes Jul 18 14:09:59.134874 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:09:59.134874 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: from cryptography.utils import int_from_bytes Jul 18 14:09:59.155846 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:09:59.155846 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: from cryptography.utils import int_from_bytes Jul 18 14:09:59.156419 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:09:59.156419 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: from cryptography.utils import int_from_bytes Jul 18 14:10:01.642530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:10:01.643041 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:10:01.643315 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:10:01.643671 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:10:01.643921 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:10:01.644300 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.644616 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.644932 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.645289 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.645596 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.645908 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.646227 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.646543 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.646870 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.647125 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.647455 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.647755 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-58-iscsi {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.648070 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.648372 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.648675 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.648987 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.649288 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.649720 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.650024 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.650609 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.651046 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.651349 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.651655 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.651990 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.652308 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.652692 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.652998 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.653302 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.653788 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.654112 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.654515 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-58-iscsi {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.655004 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.655397 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.655782 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.656200 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.656564 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.656957 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.657366 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.657816 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.658127 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.658452 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.658770 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.659086 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.659403 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.659693 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.660002 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.660312 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.660625 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.660928 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.661225 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.661470 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.661793 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.662130 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.662436 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.662763 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.662970 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.663221 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.663614 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.664012 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.664377 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.664650 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.665063 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.665650 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.665802 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.666082 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.666400 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.666717 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.667010 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.667327 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.667667 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.668065 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.668430 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.668786 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.669102 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.669358 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.669707 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.670035 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.670407 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.670648 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.670958 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.671264 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.671543 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.671841 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.672247 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.673090 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.673090 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.673283 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.673581 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.673905 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.674220 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.674524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.674821 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.675119 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.675412 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.675712 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.676009 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.676307 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.676607 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.676902 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.677199 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.677502 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.677825 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.677926 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:10:01.678358 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:10:01.678455 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.678455 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.678649 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:10:01.678749 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.679008 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.679101 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:10:01.679265 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:10:01.679353 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.679585 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.679681 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.679882 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.679999 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.680195 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.680295 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.680492 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.680580 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.680788 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.680898 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.681099 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.681212 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.681395 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.681533 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.681714 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.681891 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682029 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682222 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682317 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682485 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682613 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682800 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.682925 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.683128 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-58-iscsi {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.683217 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.683452 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.683540 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.683761 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.683849 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684072 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684165 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684365 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684660 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684747 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.684956 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.685052 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.685253 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.685341 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.685549 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.685799 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.685920 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.686114 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.686209 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.686419 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.686506 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.686726 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.686817 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.687041 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.687141 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.687349 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.687437 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.687673 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.687779 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.688046 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.688537 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.688625 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.688706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.688784 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.688875 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.688875 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.689039 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.689215 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.689311 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-58-iscsi {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.689525 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.689622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.689878 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.689970 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.690197 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.690293 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.690507 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.690598 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.690812 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.690911 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.691116 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.691207 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.691434 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.691528 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.691737 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.691836 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.692040 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.692128 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.692344 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.692439 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.692653 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.692753 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.692966 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.693072 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.693286 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.693408 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.693597 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.693722 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.693934 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.694030 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.694242 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.694329 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.694569 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.694664 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.694843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.694930 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.695150 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.695248 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.695402 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.695505 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.695729 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.695829 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.696033 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.696129 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.696355 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.696456 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.696677 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.696775 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.696929 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.697022 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.697180 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.697300 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.697498 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.697595 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.697844 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.697949 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.698152 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.698279 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.698459 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.698556 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.698764 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.698865 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.699068 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.699156 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.699406 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.699504 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.699671 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.699769 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.699976 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.700064 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.700281 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.700372 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.700593 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.700689 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.700899 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.700995 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.701213 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.701307 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.701519 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.701617 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.701853 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.701942 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.702159 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.702246 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.702467 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.702564 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.702772 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.702860 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.703076 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.703419 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.703679 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.704537 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.704646 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.704730 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.704810 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.704888 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.704982 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.705066 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.705145 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.705224 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.705313 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.705383 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.705457 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.705538 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.705616 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.705761 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.705882 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.706099 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.706200 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.706406 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.706503 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.706656 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.706787 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.706959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.707092 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.707263 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.707401 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.707581 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.707727 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.707888 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.707980 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.708190 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.708277 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.708495 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.708616 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.708794 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.708891 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.709098 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.709195 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.709412 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.709510 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.709742 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.709861 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.710104 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.710216 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.710424 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.710531 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.710652 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.710731 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.710954 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.711146 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.711240 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.711319 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.711545 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.711638 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.711846 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.711940 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.712152 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.712243 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.712460 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.712550 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.712758 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.712851 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.713062 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.713211 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.713364 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.713469 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.713686 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.713775 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.714000 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.714087 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.714305 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.714394 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.714615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.714713 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.714911 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.715008 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.715215 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.715302 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.715511 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.715598 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.715809 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.715909 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.716106 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.716193 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.716407 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.716508 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.716702 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.716799 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.716999 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.717087 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.717298 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.717395 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.717592 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.717713 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.717917 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.718015 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.718217 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.718302 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.718521 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.718610 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.718840 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.718935 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.719234 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.719714 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.719892 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.719977 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.720067 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.720156 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.720237 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.720364 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.720523 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.720612 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.720880 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.721037 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.721173 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.721306 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.721479 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.721622 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.721821 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.721960 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.722103 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:10:01.722252 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.722430 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.722566 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.722735 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.722868 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723039 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723187 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723343 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723435 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723656 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723745 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.723959 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724059 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724268 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724365 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724571 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724659 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724888 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.724986 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.725191 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.725344 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.725502 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.725600 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.725826 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.725920 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.726135 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.726222 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.726456 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.726599 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.726771 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.726860 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.727076 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.727231 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.727396 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.727485 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.727698 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.727788 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728003 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728091 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728303 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728390 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728604 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728692 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.728904 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729010 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729204 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729306 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729514 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729601 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729841 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.729931 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.730168 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.730271 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.730451 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.730547 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.730763 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.730851 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731065 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731215 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731373 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731523 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731665 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731800 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.731941 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.732086 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.732265 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.732407 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.732589 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.732725 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.732890 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.733027 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.733177 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.733311 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.733494 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.733627 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.733868 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.734005 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.734154 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.734302 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.734508 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.734650 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.735340 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.735432 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.735432 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.735735 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.735873 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736007 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736150 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736241 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736413 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736544 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736640 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736720 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.736939 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737090 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737232 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737364 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737496 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737602 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737798 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.737939 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738090 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738225 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738373 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738523 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738654 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738786 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.738921 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739055 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739220 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739316 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739316 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739464 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739582 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739678 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.739907 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.740368 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.740547 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.740682 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.740844 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.740979 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.741127 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.741221 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.741419 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.741553 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.741712 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.741812 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742049 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742182 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742360 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742495 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742655 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742788 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.742973 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743120 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743244 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743339 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743547 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743673 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743850 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.743944 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.744154 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.744251 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.744456 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.744563 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.744767 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.744860 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.745070 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.745171 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.745372 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.745470 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.745691 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.745797 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746000 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746088 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746306 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746402 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746609 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746696 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.746916 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747019 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747213 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747300 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747520 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747607 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747822 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.747911 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.748118 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.748209 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.748417 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.748506 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.748797 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.748897 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.749046 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.749305 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.749393 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.749630 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.749735 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.749955 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.750134 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.750279 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.750466 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.750587 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.750791 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.750881 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.751190 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.751284 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.751480 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.751575 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.751779 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.751881 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.752081 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.752169 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.752404 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.752505 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.752706 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.752793 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753007 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753095 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753306 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753393 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753604 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753723 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.753932 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754023 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754229 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754316 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754527 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754616 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754829 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.754921 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.755126 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.755213 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.755422 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.755521 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.755718 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.755806 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756013 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756322 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756418 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756619 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.756921 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757008 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757222 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757326 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757537 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757624 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757863 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.757951 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.758159 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.758257 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.758455 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.758543 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.758750 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.758852 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759085 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759193 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759380 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759479 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759681 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759768 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.759995 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.760084 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.760332 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.760420 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.760626 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.760720 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.760922 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761011 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761238 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761326 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761535 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761633 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761858 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.761948 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.762155 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.762251 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.762458 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.762546 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.762759 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.762857 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763056 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763144 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763359 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763455 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763666 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763805 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.763966 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764068 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764268 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764380 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764562 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764698 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764862 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.764950 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.765157 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.765255 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.765461 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.765549 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.765971 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766417 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766504 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766606 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766606 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766757 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766862 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.766951 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.767177 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.767292 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.767476 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.767564 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.767781 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.767883 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768078 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768179 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768385 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768472 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768680 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768765 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.768980 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769094 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769274 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769380 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769576 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769687 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769905 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.769995 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.770200 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.770288 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.770502 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.770589 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.770807 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.770895 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.771109 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.771205 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.771448 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.771603 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.771691 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.771770 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772025 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772126 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772281 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772385 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772582 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772671 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772897 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.772994 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.773204 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.773301 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.773501 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.773590 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.773827 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.773916 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.774124 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.774304 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.774421 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.774510 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.774718 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.774807 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775025 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775151 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775322 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775421 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775616 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775713 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.775913 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.776011 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.776211 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.776338 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.776543 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.776640 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.776907 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777010 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777146 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777356 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777728 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777847 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.777982 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.778123 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.778281 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.778448 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.778619 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.778780 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.778917 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.779074 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.779272 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.779384 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.779574 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.779696 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.779885 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780005 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780196 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780317 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780503 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780640 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780804 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.780953 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.781154 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.781265 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.781931 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782151 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782257 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782342 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782502 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782613 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782685 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.782852 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.783058 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.783170 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.783459 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.783690 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.783821 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784031 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784158 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784349 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784475 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784667 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784807 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.784986 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.785128 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.785281 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.785404 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.785583 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.785790 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.785915 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786034 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786200 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786354 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786488 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786630 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786792 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.786917 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787095 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787229 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787432 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787576 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787697 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787828 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.787984 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.788110 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.788285 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.788410 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.788584 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.788719 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.788888 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789013 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789189 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789316 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789486 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789625 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789825 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.789963 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.790129 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.790264 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.790426 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.790550 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.790731 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.790853 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791025 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791149 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791326 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791460 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791620 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791754 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.791937 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792061 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792242 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792366 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792545 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792689 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792847 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.792979 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.793189 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.793338 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.793491 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.793638 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.793823 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.793972 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.794133 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.794261 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.794433 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.794574 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.794786 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.794909 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.795095 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.795226 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.795419 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.795552 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.795719 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.795841 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796015 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796136 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796314 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796441 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796620 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796748 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.796949 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.797079 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.797312 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.797456 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.797747 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.797877 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798059 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798224 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798366 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798548 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798678 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798851 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.798974 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.799170 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.799306 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.799538 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.799672 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.799853 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.799989 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.800155 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.800278 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.800506 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.800631 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.800761 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.800880 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.801109 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.801239 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.801367 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.801472 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.801618 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.801868 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802005 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802242 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802366 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802553 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802686 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802854 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.802976 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.803156 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.803280 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.803454 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.803577 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.803765 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.803893 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804073 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804189 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804375 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804500 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804670 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804794 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.804990 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.805115 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.805298 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.805437 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.805600 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.805789 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.805912 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806043 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806222 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806360 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806526 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806651 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806835 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.806970 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.807157 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.807301 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.807475 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.807647 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.807861 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808033 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808166 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808298 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808435 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808554 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808672 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808790 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.808922 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809049 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809233 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809361 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809535 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809686 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809862 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.809986 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.810161 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.810284 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.810459 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.810582 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.810758 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.810885 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811056 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811179 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811370 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811494 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811666 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811789 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.811968 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.812091 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.812270 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.812403 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.812643 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.812776 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.813042 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.813203 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.813401 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.813633 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.813788 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.814044 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.814242 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.814448 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.814660 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.814805 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.814975 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.815158 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.815295 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.815582 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.815715 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.815898 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.816036 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.816209 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.816522 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.816672 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.816822 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.816996 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.817131 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.817424 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.817557 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.817763 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.818002 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.818107 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.818381 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.818478 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.818704 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.818945 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.819043 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.819318 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.819441 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.819628 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.819932 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.820033 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.820237 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.820434 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.820540 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.820841 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.820952 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.821150 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.821354 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.821450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.821793 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.821894 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.822105 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.822281 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.822420 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.822731 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.822852 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.823039 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.823179 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.823347 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.823645 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.823742 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.823970 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.824182 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.824270 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.824568 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.824729 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.824878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.825187 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.825277 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.825495 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.825812 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.825905 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.826248 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.826345 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.826559 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.826871 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.826958 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.827175 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.827405 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.827495 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.827780 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.827975 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.828122 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.828565 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.828986 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.829125 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.829262 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.829409 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.829544 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.829728 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.829864 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.830142 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.830275 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.830468 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.830739 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.830887 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.831073 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.831278 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.831415 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.831697 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.831875 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.832021 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.832295 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.832459 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.832623 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.832931 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.833028 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.833254 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.833527 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.833708 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.834007 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.834107 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.834315 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.834683 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.834778 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.835031 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.835242 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.835339 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.835656 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.835792 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.835981 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.836305 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.836392 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.836611 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.836886 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.836975 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.837221 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.837467 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.837590 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.837956 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838099 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838243 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838383 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838519 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838655 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838806 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.838949 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.839084 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.839263 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.839407 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.839580 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.839746 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.840020 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.840171 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.840439 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.840600 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.840765 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.840925 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.841066 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.841192 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.841374 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.841519 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.841761 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.841903 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842045 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842181 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842324 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842461 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842747 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.842890 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843038 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843180 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843330 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843486 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843641 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843780 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.843968 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.844114 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.844267 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.844411 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.844727 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.844887 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.845154 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.845301 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.845506 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.845647 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.845832 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.845968 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.846111 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.846249 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.846409 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.846549 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.846700 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.846837 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847020 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847178 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847347 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847497 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847634 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847771 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.847961 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.848104 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.848271 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.848417 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.848580 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.848720 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.848883 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849049 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849188 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849311 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849481 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849612 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849819 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.849952 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.850145 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.850303 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.850449 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.850599 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.850752 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.850843 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.851068 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.851240 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.851399 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.851726 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.851822 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.852148 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.852326 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.852581 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.852679 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.852855 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.853029 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.853272 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.853369 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.853577 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.853737 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.853916 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854015 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854221 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854310 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854575 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854667 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854885 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.854985 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.855195 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.855284 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.855499 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.855595 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.855799 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.855890 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.856100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.856197 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.856423 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.856518 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.856723 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.856813 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857019 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857107 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857335 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857432 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857637 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857747 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.857968 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.858199 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.858294 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.858396 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.858566 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.858656 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.858881 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.859087 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.859212 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.859454 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.859640 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.859868 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.860075 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.860182 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.860384 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.860566 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.860699 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.860808 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861005 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861118 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861343 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861517 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861612 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861730 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.861949 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.862086 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.862235 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.862338 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.862562 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.862700 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.862866 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863056 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863166 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863255 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863445 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863581 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863744 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.863880 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.864023 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.864126 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.864345 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.864482 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.864637 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.864912 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.865368 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.865534 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.865627 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.865882 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.865975 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.866182 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.866274 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.866484 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.866577 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.866784 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.866877 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867079 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867171 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867380 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867474 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867673 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867766 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.867976 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868070 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868268 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868368 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868567 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868669 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868870 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.868963 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.869168 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.869261 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.869467 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.869570 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.869794 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.869890 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.870149 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.870288 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.870462 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.870569 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.870756 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.870847 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871055 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871158 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871348 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871439 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871651 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871742 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.871967 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872057 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872274 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872373 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872578 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872669 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872888 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.872976 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.873199 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.873293 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.873512 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.873785 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.873891 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.874116 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.874206 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.874431 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.874519 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.874752 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.874841 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.875086 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.875190 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.875446 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.875587 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.875779 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.875985 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.876089 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.876294 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.876383 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.876616 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.876705 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.876925 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.877015 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.877231 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.877505 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.877599 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.877849 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.877955 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.878155 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.878255 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.878461 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.878550 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.878765 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.878869 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879071 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879160 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879374 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879463 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879679 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879776 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.879988 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880087 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880292 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880393 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880595 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880685 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880900 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.880988 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.881203 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.881299 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.881523 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.881617 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.881856 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.881947 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.882159 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.882263 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.882472 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.882622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.882774 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.882928 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.883078 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.883299 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.883446 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.883645 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.883735 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.883958 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884046 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884281 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884381 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884704 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884885 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.884975 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.885200 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.885290 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.885522 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.885613 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.885853 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.885958 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.886162 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.886259 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.886479 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.886570 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.886789 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.886889 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.887093 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.887183 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.887401 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.887504 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.887710 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.887809 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888013 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888103 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888316 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888419 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888630 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888787 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.888932 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889022 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889257 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889348 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889556 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889646 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889882 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.889973 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.890179 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.890268 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.890483 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.890574 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.890901 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.890995 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.891208 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.891296 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.891506 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.891584 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.891805 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.891893 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.892109 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.892212 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.892407 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.892496 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.892706 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.892795 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893002 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893104 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893300 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893396 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893601 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893709 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.893924 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894037 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894221 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894311 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894518 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894606 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894814 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.894912 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.895109 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.895199 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.895407 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.895507 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.895715 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.895814 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896011 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896110 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896309 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896397 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896601 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896691 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896898 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.896987 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.897193 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.897313 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.897519 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.897874 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.897981 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.898183 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.898271 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.898500 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.898598 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.898804 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.898903 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.899121 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.899218 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.899427 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.899517 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.899736 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.899823 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900043 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900142 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900352 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900455 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900656 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900749 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.900963 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901051 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901273 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901460 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901577 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901681 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901906 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.901995 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.902213 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.902303 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.902518 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.902614 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.902823 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.902925 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.903128 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.903217 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.903436 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.903525 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.903736 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.903834 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904042 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904131 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904351 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904440 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904662 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904758 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.904970 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.905060 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.905274 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.905362 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.905607 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.905753 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.905935 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.906025 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.906240 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.906385 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.906652 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.906758 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.906888 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907005 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907197 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907288 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907507 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907598 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907817 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.907915 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.908122 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.908222 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.908506 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.908608 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.908809 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.908896 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.909047 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.909151 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.909370 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.909464 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.909689 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.909795 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910016 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910117 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910338 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910427 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910679 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910781 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.910985 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.911076 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.911301 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.911390 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.911623 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.911712 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.911927 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.912017 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.912233 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.912330 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.912532 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.912622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.912773 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103207) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:10:01.912898 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.913223 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.913529 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.913864 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.914172 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.914483 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.914803 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.915119 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.915424 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.915734 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.916044 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.916350 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.916655 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.916960 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.917264 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.917572 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.917903 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.918208 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.918513 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.918818 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.919122 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.919426 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.919736 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.920040 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.920345 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.920647 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.920951 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.921254 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.921586 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.921984 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.922336 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.922660 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.922971 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.923295 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.923604 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.923926 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.924247 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.924562 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.924872 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.925208 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.925518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.925852 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.926164 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.926473 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.926782 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.927094 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.927418 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.927743 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.928048 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.928374 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.928692 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.929013 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.929329 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.929636 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.929991 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.930302 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.930614 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.930922 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.931232 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.931543 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.931857 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.932166 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.932476 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.932791 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.933105 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.933452 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.933784 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.934096 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.934423 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.934749 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.935101 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.935414 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.935762 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.936117 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.936398 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.936714 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.937015 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:10:01.937259 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103208) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:10:01.973268 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Registered counter for database nova_api Jul 18 14:10:01.999107 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO dbcounter [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Registered counter for database nova_api Jul 18 14:10:02.090595 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.101454 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.112307 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_db.sqlalchemy.engines [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.119899 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writer thread running {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.160931 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.context [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d09de4-139b-4035-8793-feb7f7782efc(cell1) {{(pid=103207) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 14:10:02.164909 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.166528 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.167330 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.169510 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_concurrency.lockutils [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103207) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.171560 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Registered counter for database nova_cell0 Jul 18 14:10:02.176379 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Registered counter for database nova_cell1 Jul 18 14:10:02.177124 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.context [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d09de4-139b-4035-8793-feb7f7782efc(cell1) {{(pid=103208) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 14:10:02.181180 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.182787 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.183635 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:10:02.185927 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:10:02.186550 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.187366 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.188161 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO dbcounter [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Registered counter for database nova_cell0 Jul 18 14:10:02.192492 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO dbcounter [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Registered counter for database nova_cell1 Jul 18 14:10:02.195248 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.196517 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.200383 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_db.sqlalchemy.engines [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.203679 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_db.sqlalchemy.engines [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.207724 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writer thread running {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.349889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writer thread running {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.350532 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO dbcounter [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Registered counter for database nova_cell0 Jul 18 14:10:02.359596 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG oslo_db.sqlalchemy.engines [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103207) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.361217 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO dbcounter [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Registered counter for database nova_cell0 Jul 18 14:10:02.365789 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writer thread running {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.371227 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_db.sqlalchemy.engines [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103208) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:10:02.376576 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writer thread running {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:10:02.708941 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: WARNING keystonemiddleware.auth_token [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:10:02.714038 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:10:02.716504 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: WARNING keystonemiddleware.auth_token [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:10:02.721963 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:10:03.057708 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: WARNING keystonemiddleware.auth_token [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:10:03.063776 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: WARNING keystonemiddleware.auth_token [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:10:03.068886 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55822dfc49c0 pid: 103208 (default app) Jul 18 14:10:03.071024 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:10:03.072229 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] 10.222.0.71 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001781 Jul 18 14:10:03.072642 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 1/1] 10.222.0.71 () {50 vars in 788 bytes} [Mon Jul 18 14:10:03 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:10:03.073048 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:10:03.079976 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: WARNING keystonemiddleware.auth_token [None req-1c8d4b28-87ea-4463-beae-3cb34f66b9ac None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:10:03.085258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55822dfc49c0 pid: 103207 (default app) Jul 18 14:11:24.630581 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:24.631596 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001601 Jul 18 14:11:24.632360 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 2/2] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:24.651183 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=3 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:24.652814 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell0:SELECT=3 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:24.654927 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell1:SELECT=3 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:24.655841 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:25.590568 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-b143ec66-fd33-45bc-98a4-ee95a58e56f4 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:25.621587 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-b143ec66-fd33-45bc-98a4-ee95a58e56f4 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.978900 Jul 18 14:11:25.623168 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 1/3] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 18 14:11:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:27.860185 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:27.861102 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-a635fc32-65f5-4795-8068-43d6006f194e None None] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Jul 18 14:11:27.861488 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 3/4] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:28.365229 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-df7697dc-a494-4a28-b281-30e39cd7c861 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "ram": 256}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:28.383959 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:11:28.383959 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Jul 18 14:11:28.414989 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-df7697dc-a494-4a28-b281-30e39cd7c861 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.546395 Jul 18 14:11:28.415834 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 2/5] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:28.633566 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-52f1e8a3-ecc2-4f68-a240-3f8546828280 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:28.637620 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:11:28.637620 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: warnings.warn(msg) Jul 18 14:11:28.652297 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_api:SELECT=3 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:28.653470 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_cell0:SELECT=3 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:28.654459 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_cell1:SELECT=3 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:28.655073 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:28.712756 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-52f1e8a3-ecc2-4f68-a240-3f8546828280 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.288388 Jul 18 14:11:28.714608 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 4/6] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 18 14:11:28 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:30.955539 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-df7697dc-a494-4a28-b281-30e39cd7c861 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:30.956562 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-df7697dc-a494-4a28-b281-30e39cd7c861 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Jul 18 14:11:30.956964 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 3/7] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:31.694235 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-bf025027-ac52-4097-b1fb-8fc0ef717c53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:31.719007 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:11:31.719007 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: warnings.warn(msg) Jul 18 14:11:31.743498 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-bf025027-ac52-4097-b1fb-8fc0ef717c53 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.780035 Jul 18 14:11:31.744666 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 5/8] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:11:31.756764 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-af760f1f-6af9-41c0-b64f-ecea0fbccade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:31.758317 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:11:31.758317 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: warnings.warn(msg) Jul 18 14:11:31.790925 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-af760f1f-6af9-41c0-b64f-ecea0fbccade admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037767 Jul 18 14:11:31.791513 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 4/9] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 18 14:11:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:34.147143 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-bf025027-ac52-4097-b1fb-8fc0ef717c53 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:34.147762 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-bf025027-ac52-4097-b1fb-8fc0ef717c53 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 18 14:11:34.154411 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 6/10] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:34 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:34.651398 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-4e413f67-b8d6-4bdc-838b-b8e726b3d385 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:34.672418 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-4e413f67-b8d6-4bdc-838b-b8e726b3d385 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.517759 Jul 18 14:11:34.673083 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 5/11] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:34.687813 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-5cffe0c0-637b-4b3a-84b5-6e0892ffb418 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:34.714549 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-5cffe0c0-637b-4b3a-84b5-6e0892ffb418 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031408 Jul 18 14:11:34.715206 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 7/12] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 18 14:11:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:37.050566 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-4e413f67-b8d6-4bdc-838b-b8e726b3d385 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:37.051581 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-4e413f67-b8d6-4bdc-838b-b8e726b3d385 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 18 14:11:37.051985 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 6/13] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:37.546920 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-e37886bd-c0ff-429b-9d9c-15b60267cc7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "ram": 2048, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:37.566708 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-e37886bd-c0ff-429b-9d9c-15b60267cc7a admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.507943 Jul 18 14:11:37.567267 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 8/14] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:37.579477 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-fdb71407-62f4-442b-878e-8d7ef229bf30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:37.603384 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-fdb71407-62f4-442b-878e-8d7ef229bf30 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027544 Jul 18 14:11:37.603965 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 7/15] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 18 14:11:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:39.910717 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-e37886bd-c0ff-429b-9d9c-15b60267cc7a admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:39.911668 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-e37886bd-c0ff-429b-9d9c-15b60267cc7a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 Jul 18 14:11:39.912310 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 9/16] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:40.397691 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c4af9e1c-9a34-4a3b-8573-84347f098095 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "name": "ds4G", "disk": 20, "id": "d4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:40.425232 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-c4af9e1c-9a34-4a3b-8573-84347f098095 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506322 Jul 18 14:11:40.426054 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 8/17] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:40.439564 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-0b226168-9774-4488-9b9a-2749e9a66941 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:40.470345 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-0b226168-9774-4488-9b9a-2749e9a66941 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034728 Jul 18 14:11:40.471116 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 10/18] 10.222.0.71 () {64 vars in 1335 bytes} [Mon Jul 18 14:11:40 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:42.907875 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c4af9e1c-9a34-4a3b-8573-84347f098095 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:42.909333 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-c4af9e1c-9a34-4a3b-8573-84347f098095 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002198 Jul 18 14:11:42.909991 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 9/19] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:43.443036 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-3306f6a4-4643-4341-ac76-bb3ec3f3b784 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:43.470075 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-3306f6a4-4643-4341-ac76-bb3ec3f3b784 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.553506 Jul 18 14:11:43.470868 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 11/20] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 18 14:11:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:11:45.861149 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c4af9e1c-9a34-4a3b-8573-84347f098095 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:45.862214 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-c4af9e1c-9a34-4a3b-8573-84347f098095 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Jul 18 14:11:45.862613 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 10/21] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:46.336720 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4980b136-9cf3-44ed-9332-43e1bee8f91a admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "disk": 1, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:46.356478 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-4980b136-9cf3-44ed-9332-43e1bee8f91a admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.486817 Jul 18 14:11:46.357808 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 12/22] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:45 2022] POST /compute/v2.1/flavors => generated 402 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:46.369493 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-8ec52eda-f71b-4f7b-90b1-8498b6569eed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:46.397586 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-8ec52eda-f71b-4f7b-90b1-8498b6569eed admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031831 Jul 18 14:11:46.398212 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 11/23] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 18 14:11:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:48.936744 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4980b136-9cf3-44ed-9332-43e1bee8f91a admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:48.937822 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-4980b136-9cf3-44ed-9332-43e1bee8f91a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jul 18 14:11:48.938237 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 13/24] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:49.405637 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-11d303cc-196f-4833-ad8c-f55e4d530bdb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "vcpus": 1, "name": "m1.small", "rxtx_factor": 1.0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "disk": 20}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:49.425086 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-11d303cc-196f-4833-ad8c-f55e4d530bdb admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480729 Jul 18 14:11:49.425638 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 12/25] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:49.438994 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-b8dbbaf2-2941-493d-bf5b-5dd9a2f277e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:49.463668 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-b8dbbaf2-2941-493d-bf5b-5dd9a2f277e3 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028715 Jul 18 14:11:49.469679 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 14/26] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 18 14:11:49 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:51.810874 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-11d303cc-196f-4833-ad8c-f55e4d530bdb admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:51.811890 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-11d303cc-196f-4833-ad8c-f55e4d530bdb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jul 18 14:11:51.812296 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 13/27] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:52.244591 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-70dc0975-137b-4129-884e-75392775d6c0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "id": "3", "name": "m1.medium"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:52.265519 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-70dc0975-137b-4129-884e-75392775d6c0 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.446608 Jul 18 14:11:52.273066 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 15/28] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:52.278761 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-40c62530-a8d8-4540-816d-e845be858e66 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:52.302759 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-40c62530-a8d8-4540-816d-e845be858e66 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028266 Jul 18 14:11:52.303348 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 14/29] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 18 14:11:52 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:54.687150 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-70dc0975-137b-4129-884e-75392775d6c0 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:54.688848 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-70dc0975-137b-4129-884e-75392775d6c0 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002168 Jul 18 14:11:54.689432 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 16/30] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:11:55.274045 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-ad55d6e4-7d66-4b6c-8b77-92394126a64f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "4", "disk": 80, "vcpus": 4}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:55.280647 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:11:55.299682 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-ad55d6e4-7d66-4b6c-8b77-92394126a64f admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.603347 Jul 18 14:11:55.300410 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 15/31] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:55.312919 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-80d9e166-256c-41f6-838f-feb8a61386df admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:55.339775 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-80d9e166-256c-41f6-838f-feb8a61386df admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030956 Jul 18 14:11:55.340486 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 17/32] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 18 14:11:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:11:57.718430 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-ad55d6e4-7d66-4b6c-8b77-92394126a64f admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:11:57.720486 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-ad55d6e4-7d66-4b6c-8b77-92394126a64f admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002711 Jul 18 14:11:57.721099 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 16/33] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:11:57 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:11:58.320102 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-fc6bd74e-cec5-474c-b26d-3f03e7165854 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "os-flavor-access:is_public": true, "name": "m1.xlarge", "ram": 16384}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:58.340243 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-fc6bd74e-cec5-474c-b26d-3f03e7165854 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.612221 Jul 18 14:11:58.340808 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 18/34] 10.222.0.71 () {64 vars in 1282 bytes} [Mon Jul 18 14:11:57 2022] POST /compute/v2.1/flavors => generated 408 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:11:58.360554 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-cde1cee8-80a3-48b0-ac7c-8c59d9ed6152 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:11:58.402332 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-cde1cee8-80a3-48b0-ac7c-8c59d9ed6152 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.048142 Jul 18 14:11:58.403394 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 17/35] 10.222.0.71 () {64 vars in 1332 bytes} [Mon Jul 18 14:11:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:12:18.834511 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-fc6bd74e-cec5-474c-b26d-3f03e7165854 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:18.835534 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-fc6bd74e-cec5-474c-b26d-3f03e7165854 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 18 14:12:18.835946 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 19/36] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:12:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:12:18.847154 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:19.309104 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-884c8f70-ac14-46b0-99fa-b64072a94e02 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:19.327571 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-884c8f70-ac14-46b0-99fa-b64072a94e02 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.484862 Jul 18 14:12:19.328125 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 18/37] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 18 14:12:18 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:20.444999 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-fc6bd74e-cec5-474c-b26d-3f03e7165854 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:20.446278 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-fc6bd74e-cec5-474c-b26d-3f03e7165854 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001634 Jul 18 14:12:20.446705 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 20/38] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:21.035523 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-ca3892a1-c118-4daf-9973-269ef37525f5 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:21.041420 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.wsgi [None req-ca3892a1-c118-4daf-9973-269ef37525f5 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-ca3892a1-c118-4daf-9973-269ef37525f5 admin admin] Request method failure captured: Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Accept: application/json Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Accept-Encoding: gzip, deflate Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Connection: keep-alive Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Content-Length: 0 Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Host: 10.222.0.71 Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Openstack-Api-Version: compute 2.90 Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Openstack-System-Scope: None Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: User-Agent: python-novaclient Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Auth-Token: gAAAAABi1WpE-qlpVUBO-LqdAf1ldyU6Yo5k-RCQeLr3mgyyPZCQeFzBTddm5gzdbdhStNasY5vWFEo_OHCplWK5e_ki6AFmA-UbFA0ylRdl3rVy2wUPZlUxmFvPqjjuy5HwWSWzuYbyzUKbq8BCAAreuRzLLB2n3hhnqA0hboxcWFM_wx-Q6Bg Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Domain-Id: None Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Domain-Name: None Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Identity-Status: Confirmed Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Is-Admin-Project: True Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Domain-Id: default Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Domain-Name: Default Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Name: admin Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Role: reader,member,admin Jul 18 14:12:21.044937 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Roles: reader,member,admin Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1db40e87aaf497fb0528cd53913ada9", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant: admin Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant-Name: admin Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User: admin Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Domain-Id: default Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Domain-Name: Default Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Id: 86f9463b664941f0b5c63b336b679b58 Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Name: admin Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: method: > Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: exception: Flavor 42 could not be found. Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: action_args: {'id': '42'} Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:12:21.046615 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:21.047676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.049089 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-ca3892a1-c118-4daf-9973-269ef37525f5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:12:21.050495 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-ca3892a1-c118-4daf-9973-269ef37525f5 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.454648 Jul 18 14:12:21.050495 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 19/39] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 18 14:12:20 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 456 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:21.057916 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-a4da2bca-5c94-47dc-a494-545384b8316c admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:21.060811 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:12:21.080970 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-a4da2bca-5c94-47dc-a494-545384b8316c admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026704 Jul 18 14:12:21.081568 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 21/40] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 18 14:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:21.094364 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-bce46863-0d29-41e0-aba2-514b4bac89cb admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:21.117442 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-bce46863-0d29-41e0-aba2-514b4bac89cb admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028668 Jul 18 14:12:21.118074 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 20/41] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 18 14:12:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:21.129012 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4fb5c69e-25cc-471c-adc0-250fd47f2498 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:21.136855 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.wsgi [None req-4fb5c69e-25cc-471c-adc0-250fd47f2498 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4fb5c69e-25cc-471c-adc0-250fd47f2498 admin admin] Request method failure captured: Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Accept: application/json Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Accept-Encoding: gzip, deflate Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Connection: keep-alive Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Content-Length: 0 Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Host: 10.222.0.71 Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Openstack-Api-Version: compute 2.90 Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Openstack-System-Scope: None Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: User-Agent: python-novaclient Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Auth-Token: gAAAAABi1WpE-qlpVUBO-LqdAf1ldyU6Yo5k-RCQeLr3mgyyPZCQeFzBTddm5gzdbdhStNasY5vWFEo_OHCplWK5e_ki6AFmA-UbFA0ylRdl3rVy2wUPZlUxmFvPqjjuy5HwWSWzuYbyzUKbq8BCAAreuRzLLB2n3hhnqA0hboxcWFM_wx-Q6Bg Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Domain-Id: None Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Domain-Name: None Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Identity-Status: Confirmed Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Is-Admin-Project: True Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Domain-Id: default Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Domain-Name: Default Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Name: admin Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Role: reader,member,admin Jul 18 14:12:21.140706 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Roles: reader,member,admin Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1db40e87aaf497fb0528cd53913ada9", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant: admin Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant-Name: admin Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User: admin Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Domain-Id: default Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Domain-Name: Default Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Id: 86f9463b664941f0b5c63b336b679b58 Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Name: admin Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: method: > Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: exception: Flavor 42 could not be found. Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: action_args: {'id': '42'} Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:12:21.142518 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:21.143450 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:21.144622 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4fb5c69e-25cc-471c-adc0-250fd47f2498 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:12:21.145994 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-4fb5c69e-25cc-471c-adc0-250fd47f2498 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017214 Jul 18 14:12:21.146225 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 22/42] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 18 14:12:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:22.151252 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-bce46863-0d29-41e0-aba2-514b4bac89cb admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.152479 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-bce46863-0d29-41e0-aba2-514b4bac89cb admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001632 Jul 18 14:12:22.152943 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 21/43] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:22.787621 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-2f8f55c8-231b-4da5-87fd-437b06e76963 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.794327 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.wsgi [None req-2f8f55c8-231b-4da5-87fd-437b06e76963 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-2f8f55c8-231b-4da5-87fd-437b06e76963 admin admin] Request method failure captured: Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Accept: application/json Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Accept-Encoding: gzip, deflate Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Connection: keep-alive Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Content-Length: 0 Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Host: 10.222.0.71 Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Openstack-Api-Version: compute 2.90 Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Openstack-System-Scope: None Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: User-Agent: python-novaclient Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Auth-Token: gAAAAABi1WpG7WHRHN4WxC_q7pKXinCzUa420g-8wVUjz7KiKkxs9jyp6eDr3nOGB3YhBQbAImfiZDzKB5lvzlvc-maVlelWefmiRgGk3Az8Rx2rkocxnwbS8RPSzhVRfaUyNBpA2BnROFRJnSJPHqGfYaccFJY_PLM8gQLAlgNHpH2f9OzYqhA Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Domain-Id: None Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Domain-Name: None Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Identity-Status: Confirmed Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Is-Admin-Project: True Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Domain-Id: default Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Domain-Name: Default Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Name: admin Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Role: reader,member,admin Jul 18 14:12:22.795889 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Roles: reader,member,admin Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1db40e87aaf497fb0528cd53913ada9", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant: admin Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant-Name: admin Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User: admin Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Domain-Id: default Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Domain-Name: Default Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Id: 86f9463b664941f0b5c63b336b679b58 Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Name: admin Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: method: > Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: exception: Flavor 84 could not be found. Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: action_args: {'id': '84'} Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:12:22.797458 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:22.798541 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.799878 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-2f8f55c8-231b-4da5-87fd-437b06e76963 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:12:22.801229 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-2f8f55c8-231b-4da5-87fd-437b06e76963 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.499964 Jul 18 14:12:22.801229 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 23/44] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:22.807359 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-659efad0-31ac-4e4f-b920-a296417210ad admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.821449 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-659efad0-31ac-4e4f-b920-a296417210ad admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017874 Jul 18 14:12:22.822043 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 22/45] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:22.832034 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4b8dfecc-6f59-4a4e-8d9b-fb3a1a22009d admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.846832 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-4b8dfecc-6f59-4a4e-8d9b-fb3a1a22009d admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018213 Jul 18 14:12:22.847270 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 24/46] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:22.858358 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c92cfffe-e4e8-4139-a792-999baf882a74 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:22.864613 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.wsgi [None req-c92cfffe-e4e8-4139-a792-999baf882a74 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c92cfffe-e4e8-4139-a792-999baf882a74 admin admin] Request method failure captured: Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Accept: application/json Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Accept-Encoding: gzip, deflate Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Connection: keep-alive Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Content-Length: 0 Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Host: 10.222.0.71 Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Openstack-Api-Version: compute 2.90 Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Openstack-System-Scope: None Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: User-Agent: python-novaclient Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Auth-Token: gAAAAABi1WpG7WHRHN4WxC_q7pKXinCzUa420g-8wVUjz7KiKkxs9jyp6eDr3nOGB3YhBQbAImfiZDzKB5lvzlvc-maVlelWefmiRgGk3Az8Rx2rkocxnwbS8RPSzhVRfaUyNBpA2BnROFRJnSJPHqGfYaccFJY_PLM8gQLAlgNHpH2f9OzYqhA Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Domain-Id: None Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Domain-Name: None Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Identity-Status: Confirmed Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Is-Admin-Project: True Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Domain-Id: default Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Domain-Name: Default Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Name: admin Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Role: reader,member,admin Jul 18 14:12:22.866160 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Roles: reader,member,admin Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1db40e87aaf497fb0528cd53913ada9", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant: admin Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant-Name: admin Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User: admin Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Domain-Id: default Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Domain-Name: Default Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Id: 86f9463b664941f0b5c63b336b679b58 Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Name: admin Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: method: > Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: exception: Flavor 84 could not be found. Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: action_args: {'id': '84'} Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:12:22.868590 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:22.870524 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:22.873258 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-c92cfffe-e4e8-4139-a792-999baf882a74 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:12:22.875933 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-c92cfffe-e4e8-4139-a792-999baf882a74 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013928 Jul 18 14:12:22.875933 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 23/47] 10.222.0.71 () {60 vars in 1190 bytes} [Mon Jul 18 14:12:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:23.871983 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-4b8dfecc-6f59-4a4e-8d9b-fb3a1a22009d admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:23.873358 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-4b8dfecc-6f59-4a4e-8d9b-fb3a1a22009d admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001998 Jul 18 14:12:23.873922 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 25/48] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:24.439312 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-f9116eca-0637-4447-a189-f8a1e8dfae0c admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:24.446110 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.wsgi [None req-f9116eca-0637-4447-a189-f8a1e8dfae0c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-f9116eca-0637-4447-a189-f8a1e8dfae0c admin admin] Request method failure captured: Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Accept: application/json Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Accept-Encoding: gzip, deflate Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Connection: keep-alive Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Content-Length: 0 Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Host: 10.222.0.71 Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Openstack-Api-Version: compute 2.90 Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Openstack-System-Scope: None Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: User-Agent: python-novaclient Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Auth-Token: gAAAAABi1WpH7atjSOv4C7eRZRmKTKY_fWCwrHK4IX9tDy1OxJgy1GQKK0EsKX95KKAQxxYSC1oApnFAgphr057SK36VHeNfbbzhka3YZgBr70xc6gv2TevXw4iq0BWDJUO4PeGGe-1YtlZSQDJjrJJ9v0sDFATWJyroubdtZaAu_Il5BH6pScQ Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Domain-Id: None Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Domain-Name: None Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Identity-Status: Confirmed Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Is-Admin-Project: True Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Domain-Id: default Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Domain-Name: Default Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Project-Name: admin Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Role: reader,member,admin Jul 18 14:12:24.447624 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Roles: reader,member,admin Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1db40e87aaf497fb0528cd53913ada9", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant: admin Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-Tenant-Name: admin Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User: admin Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Domain-Id: default Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Domain-Name: Default Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Id: 86f9463b664941f0b5c63b336b679b58 Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: X-User-Name: admin Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: method: > Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: exception: Flavor 451 could not be found. Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: action_args: {'id': '451'} Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:12:24.449530 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:24.450463 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.451843 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-f9116eca-0637-4447-a189-f8a1e8dfae0c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103207) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:12:24.454557 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-f9116eca-0637-4447-a189-f8a1e8dfae0c admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.438455 Jul 18 14:12:24.454557 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 24/49] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 18 14:12:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 444 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:24.463591 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-0d91d476-4874-45ff-9568-f1de802ec313 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:24.483275 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-0d91d476-4874-45ff-9568-f1de802ec313 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026589 Jul 18 14:12:24.483844 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 26/50] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 18 14:12:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:24.494337 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:24.510641 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019993 Jul 18 14:12:24.511532 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 25/51] 10.222.0.71 () {60 vars in 1210 bytes} [Mon Jul 18 14:12:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:12:24.521350 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-e6c85a22-3da0-4528-b1f9-1045e33722d8 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:24.527334 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.wsgi [None req-e6c85a22-3da0-4528-b1f9-1045e33722d8 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-e6c85a22-3da0-4528-b1f9-1045e33722d8 admin admin] Request method failure captured: Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Accept: application/json Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Accept-Encoding: gzip, deflate Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Connection: keep-alive Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Content-Length: 0 Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Host: 10.222.0.71 Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Openstack-Api-Version: compute 2.90 Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Openstack-System-Scope: None Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: User-Agent: python-novaclient Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Auth-Token: gAAAAABi1WpH7atjSOv4C7eRZRmKTKY_fWCwrHK4IX9tDy1OxJgy1GQKK0EsKX95KKAQxxYSC1oApnFAgphr057SK36VHeNfbbzhka3YZgBr70xc6gv2TevXw4iq0BWDJUO4PeGGe-1YtlZSQDJjrJJ9v0sDFATWJyroubdtZaAu_Il5BH6pScQ Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Domain-Id: None Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Domain-Name: None Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Identity-Status: Confirmed Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Is-Admin-Project: True Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Openstack-Nova-Api-Version: 2.90 Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Domain-Id: default Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Domain-Name: Default Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Project-Name: admin Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Role: reader,member,admin Jul 18 14:12:24.528959 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Roles: reader,member,admin Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c1db40e87aaf497fb0528cd53913ada9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c1db40e87aaf497fb0528cd53913ada9", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant: admin Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant-Id: c1db40e87aaf497fb0528cd53913ada9 Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-Tenant-Name: admin Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User: admin Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Domain-Id: default Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Domain-Name: Default Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Id: 86f9463b664941f0b5c63b336b679b58 Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: X-User-Name: admin Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: method: > Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: exception: Flavor 451 could not be found. Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: action_args: {'id': '451'} Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:12:24.531100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:24.533121 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: ERROR nova.api.openstack.wsgi Jul 18 14:12:24.534751 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-e6c85a22-3da0-4528-b1f9-1045e33722d8 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103208) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:12:24.536601 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-e6c85a22-3da0-4528-b1f9-1045e33722d8 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012762 Jul 18 14:12:24.536601 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 27/52] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 18 14:12:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 18 14:12:25.565273 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:25.566300 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 18 14:12:25.566700 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 26/53] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:26.171269 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-8b5d1e8b-31ee-4e0d-9a84-df8cc0f3eb42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:26.194852 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-8b5d1e8b-31ee-4e0d-9a84-df8cc0f3eb42 admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.488827 Jul 18 14:12:26.195397 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 28/54] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 18 14:12:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:12:27.222660 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:27.224121 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002221 Jul 18 14:12:27.224676 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 27/55] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:27 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:27.818887 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-65d24ba9-e835-4c95-a089-313f70d9831c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:27.839655 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-65d24ba9-e835-4c95-a089-313f70d9831c admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.474344 Jul 18 14:12:27.839916 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 29/56] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 18 14:12:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:12:28.889006 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:28.890114 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 18 14:12:28.890453 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 28/57] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:29.492516 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-427839fb-81a2-425a-90aa-d78de69eaa7f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:29.511654 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-427839fb-81a2-425a-90aa-d78de69eaa7f admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.476295 Jul 18 14:12:29.512212 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 30/58] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 18 14:12:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:12:30.557108 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:30.559059 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002361 Jul 18 14:12:30.559460 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 29/59] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:31.139216 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-d857ea7f-7772-4ed3-a1a6-c5ddf0d9140c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:12:31.166715 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-d857ea7f-7772-4ed3-a1a6-c5ddf0d9140c admin admin] 10.222.0.71 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.465257 Jul 18 14:12:31.167403 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 31/60] 10.222.0.71 () {64 vars in 1235 bytes} [Mon Jul 18 14:12:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:12:32.190252 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:32.191249 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jul 18 14:12:32.191659 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 30/61] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:12:32.760868 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-40989da4-3887-44fe-8081-09a75ff32403 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:12:32.781671 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-40989da4-3887-44fe-8081-09a75ff32403 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.453018 Jul 18 14:12:32.782233 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 32/62] 10.222.0.71 () {60 vars in 1202 bytes} [Mon Jul 18 14:12:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:13:27.817025 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:27.818059 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-790c0805-9d39-4055-9fad-aae8b7a0a62a admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Jul 18 14:13:27.818465 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 31/63] 10.222.0.71 () {54 vars in 930 bytes} [Mon Jul 18 14:13:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:13:27.829861 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:28.267871 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-c9a80904-7fbf-48c6-a99c-29daee35a28f admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:28.287202 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-c9a80904-7fbf-48c6-a99c-29daee35a28f admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.461968 Jul 18 14:13:28.287768 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 33/64] 10.222.0.71 () {60 vars in 1291 bytes} [Mon Jul 18 14:13:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:13:28.308908 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG dbcounter [-] [103207] Writing DB stats nova_api:SELECT=14 {{(pid=103207) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:13:28.312909 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-4fa6ede2-2335-4ab7-aa60-3fc9d020460f admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:28.321242 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-4fa6ede2-2335-4ab7-aa60-3fc9d020460f admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013834 Jul 18 14:13:28.321792 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 32/65] 10.222.0.71 () {60 vars in 1282 bytes} [Mon Jul 18 14:13:28 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:28.333972 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-514e40a7-8e79-433a-b289-10d8e76f366b admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:28.342235 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-514e40a7-8e79-433a-b289-10d8e76f366b admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011805 Jul 18 14:13:28.342685 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 34/66] 10.222.0.71 () {60 vars in 1285 bytes} [Mon Jul 18 14:13:28 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:28.354639 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:28.362977 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012294 Jul 18 14:13:28.363831 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 33/67] 10.222.0.71 () {60 vars in 1285 bytes} [Mon Jul 18 14:13:28 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:13:28.378795 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-29f8a49f-053f-4dc9-afc6-d2f7ca01c697 admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:13:28.390174 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-29f8a49f-053f-4dc9-afc6-d2f7ca01c697 admin admin] 10.222.0.71 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017484 Jul 18 14:13:28.390731 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 35/68] 10.222.0.71 () {60 vars in 1282 bytes} [Mon Jul 18 14:13:28 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:16:59.996741 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:16:59.997782 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 18 14:16:59.998169 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 34/69] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:16:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:00.139215 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_api:SELECT=6 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:00.326175 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-7740fa5c-0609-4e6a-b7e5-40f01f6c892b admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:00.327404 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:00.327404 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: warnings.warn(msg) Jul 18 14:17:00.328613 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-7740fa5c-0609-4e6a-b7e5-40f01f6c892b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.329329 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-7740fa5c-0609-4e6a-b7e5-40f01f6c892b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.330520 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-7740fa5c-0609-4e6a-b7e5-40f01f6c892b admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:00.331138 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-7740fa5c-0609-4e6a-b7e5-40f01f6c892b admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:00.370715 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-7740fa5c-0609-4e6a-b7e5-40f01f6c892b admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.233922 Jul 18 14:17:00.371328 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 36/70] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 18 14:17:00 2022] GET /compute/v2.1/os-services => generated 794 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:17:01.227744 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:01.228819 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Jul 18 14:17:01.229230 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 35/71] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:01.431993 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-72cd1114-5aa1-4252-83d5-92aaea7591db admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:01.433100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:01.433100 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: warnings.warn(msg) Jul 18 14:17:01.434477 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-72cd1114-5aa1-4252-83d5-92aaea7591db admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.434915 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-72cd1114-5aa1-4252-83d5-92aaea7591db admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.435697 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-72cd1114-5aa1-4252-83d5-92aaea7591db admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:01.436112 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-72cd1114-5aa1-4252-83d5-92aaea7591db admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:01.456091 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-72cd1114-5aa1-4252-83d5-92aaea7591db admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.084956 Jul 18 14:17:01.456667 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 37/72] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 18 14:17:01 2022] GET /compute/v2.1/os-services => generated 794 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:17:12.703620 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:12.704623 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 18 14:17:12.705016 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 36/73] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:17:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:12.849237 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_cell0:SELECT=4 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:12.850269 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_cell1:SELECT=4 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:12.851085 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG dbcounter [-] [103208] Writing DB stats nova_api:SELECT=8 {{(pid=103208) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:17:12.906093 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-5bb56e8c-48d8-4708-a50f-85318c1e73dc admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:12.907794 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:12.907794 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: warnings.warn(msg) Jul 18 14:17:12.909646 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-5bb56e8c-48d8-4708-a50f-85318c1e73dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:12.910267 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-5bb56e8c-48d8-4708-a50f-85318c1e73dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:12.911312 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-5bb56e8c-48d8-4708-a50f-85318c1e73dc admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:12.911810 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-5bb56e8c-48d8-4708-a50f-85318c1e73dc admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:12.942976 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-5bb56e8c-48d8-4708-a50f-85318c1e73dc admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.098173 Jul 18 14:17:12.943534 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 38/74] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 18 14:17:12 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:17:13.782313 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: DEBUG nova.api.openstack.wsgi [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] Calling method '>' {{(pid=103207) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:13.783313 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: INFO nova.api.openstack.requestlog [None req-9517be65-41e5-4cc8-8455-4e94678ca3d6 admin admin] 10.222.0.71 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jul 18 14:17:13.783729 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: [pid: 103207|app: 0|req: 37/75] 10.222.0.71 () {56 vars in 1074 bytes} [Mon Jul 18 14:17:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:17:13.986974 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG nova.api.openstack.wsgi [None req-14d90b08-4d24-4e85-b5a8-a78e8d55251d admin admin] Calling method '>' {{(pid=103208) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:17:13.988184 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 18 14:17:13.988184 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: warnings.warn(msg) Jul 18 14:17:13.989365 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-14d90b08-4d24-4e85-b5a8-a78e8d55251d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:13.990172 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-14d90b08-4d24-4e85-b5a8-a78e8d55251d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:13.990955 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-14d90b08-4d24-4e85-b5a8-a78e8d55251d admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:17:13.991397 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: DEBUG oslo_concurrency.lockutils [None req-14d90b08-4d24-4e85-b5a8-a78e8d55251d admin admin] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103208) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:17:14.013413 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: INFO nova.api.openstack.requestlog [None req-14d90b08-4d24-4e85-b5a8-a78e8d55251d admin admin] 10.222.0.71 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.091292 Jul 18 14:17:14.014018 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: [pid: 103208|app: 0|req: 39/76] 10.222.0.71 () {60 vars in 1193 bytes} [Mon Jul 18 14:17:13 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:18:12.165378 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: Mon Jul 18 14:18:12 2022 - graceful shutdown triggered... Jul 18 14:18:12.164856 dv-cinder-797608-58-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 18 14:18:12.166459 dv-cinder-797608-58-iscsi devstack@n-api.service[103207]: Gracefully killing worker 1 (pid: 103207)... Jul 18 14:18:12.166835 dv-cinder-797608-58-iscsi devstack@n-api.service[103208]: Gracefully killing worker 2 (pid: 103208)... Jul 18 14:18:13.165928 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: worker 1 buried after 1 seconds Jul 18 14:18:13.165928 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: worker 2 buried after 1 seconds Jul 18 14:18:13.165928 dv-cinder-797608-58-iscsi devstack@n-api.service[103206]: goodbye to uWSGI. Jul 18 14:18:13.167882 dv-cinder-797608-58-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 18 14:18:13.168514 dv-cinder-797608-58-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 18 14:18:13.171951 dv-cinder-797608-58-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 18 14:18:13.183600 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 18 14:18:13 2022] *** Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: nodename: dv-cinder-797608-58-iscsi Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: machine: x86_64 Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: clock source: unix Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: pcre jit disabled Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: detected number of CPU cores: 4 Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: current working directory: / Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: detected binary path: /usr/bin/uwsgi-core Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: your processes number limit is 47680 Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: your memory page size is 4096 bytes Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: detected max file descriptor number: 2048 Jul 18 14:18:13.185630 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: lock engine: pthread robust mutexes Jul 18 14:18:13.186771 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: thunder lock: enabled Jul 18 14:18:13.186771 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 18 14:18:13.186771 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 18 14:18:13.225751 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: Python main interpreter initialized at 0x5596909b69c0 Jul 18 14:18:13.225751 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: python threads support enabled Jul 18 14:18:13.225751 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: your server socket listen backlog is limited to 100 connections Jul 18 14:18:13.225751 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: your mercy for graceful operations on workers is 90 seconds Jul 18 14:18:13.226239 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: mapped 403077 bytes (393 KB) for 2 cores Jul 18 14:18:13.226239 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: *** Operational MODE: preforking *** Jul 18 14:18:13.226513 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: *** uWSGI is running in multiple interpreter mode *** Jul 18 14:18:13.226513 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: spawned uWSGI master process (pid: 117748) Jul 18 14:18:13.226726 dv-cinder-797608-58-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 18 14:18:13.241838 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: spawned uWSGI worker 1 (pid: 117766, cores: 1) Jul 18 14:18:13.241838 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: spawned uWSGI worker 2 (pid: 117767, cores: 1) Jul 18 14:18:13.241838 dv-cinder-797608-58-iscsi devstack@n-api.service[117748]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 18 14:18:13.900717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 14:18:13.929306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 18 14:18:15.059811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:18:15.059811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: from cryptography.utils import int_from_bytes Jul 18 14:18:15.060811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:18:15.060811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: from cryptography.utils import int_from_bytes Jul 18 14:18:15.118155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:18:15.118155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: from cryptography.utils import int_from_bytes Jul 18 14:18:15.118767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 18 14:18:15.118767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: from cryptography.utils import int_from_bytes Jul 18 14:18:17.488452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:18:17.488991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:18:17.490199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:18:17.490799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:18:17.491183 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:18:17.491596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.491920 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.492248 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.492570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.492904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.493219 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.493557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.493928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.494291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.494528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.494873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.495176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-58-iscsi {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.495492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.495802 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.496114 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.496480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.496811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.497210 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.497576 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.498094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.498917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.499452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.499687 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.500025 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.500391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.500736 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.501038 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.501361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.501751 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.502090 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.502641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-58-iscsi {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.502968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.503276 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.503566 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.504029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.504348 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.504710 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.505157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.505491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.505834 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.506218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.506498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.506810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.507134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.507439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.507748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.508112 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.508480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.508801 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.509140 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.509397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.509735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.510064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.510389 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.510714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.510968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.511220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.511541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.511865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.512175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.512483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.512791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.513099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.513403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.513763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.514232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.514544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.514863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.515181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.515506 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.515866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.516193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.516651 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.516908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.517218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.517559 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.517907 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.518217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.518538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.518861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.519169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.519480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.519784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.520103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.520437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.520807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.521183 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.521347 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.521894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.522475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.523045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.523611 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.524273 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.524724 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.525307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.525954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.526510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.527028 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.527538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.527898 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.528215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.528531 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.528841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.529169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.529494 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.529913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.530214 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.530619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.530853 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.531203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.531586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.531928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.532240 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.532547 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.532853 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.533172 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.533480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.533829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.534191 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.534497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.534814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.535138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.535461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.535781 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.536166 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.536571 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.536947 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.537360 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.537777 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.538087 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.538407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.538750 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.539075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.539384 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.539696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.539999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.540381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.540761 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.541176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.541525 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.541878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.542214 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.542546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.542916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.543270 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.543616 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.543949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.544269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.544586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.544899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.545221 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.545544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.545907 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.546229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.546546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.546867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.547196 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.547499 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.547828 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.548151 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.548461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.548943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.549373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.549765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.550152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.550483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.550794 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.551109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.551422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.551747 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.552157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.552439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.552886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.553206 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.553521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.553915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.554186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.554515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.554839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.555152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.555465 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.555851 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.556250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.556810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.557425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.558913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.558913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.559261 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.559606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.560196 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.560791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.561385 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.562582 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.562582 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.562882 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.563195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.563516 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.563833 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.564146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.564461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.564889 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.565090 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.565397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.565751 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.566070 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.566377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.566703 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.567008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.567314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.567763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.568249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.568620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.568913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.569301 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.569635 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.570036 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.570422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.570781 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.571181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.571496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.571829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.572211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.572691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.572914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.573232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.573542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.573894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.574188 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.574503 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.574862 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.575177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.575485 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.575799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.576112 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.576443 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.576755 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.577060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.577396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.577705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.578054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.578375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.578738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.579101 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.579377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.579706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.580020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.580337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.580650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.580963 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.581275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.581587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.581939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.582252 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.582572 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.582883 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.583263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.583578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.583938 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.584271 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.584645 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.585035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.585519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.585772 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.586107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.586423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.586753 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.587065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.587385 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.587700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.588013 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.588334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.588647 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.588965 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.589279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.590235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.590235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.590541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.590716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.590913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.591258 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.591713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.592083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.592632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.593229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 18 14:18:17.593777 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.594080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 18 14:18:17.594235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.594383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 18 14:18:17.594383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 18 14:18:17.594659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.594804 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 18 14:18:17.594960 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.595141 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.595291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.595655 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.595797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.595921 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.596219 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.596322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.596539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.596859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.597002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.597193 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.597443 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.597621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.597940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.598076 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.598243 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.598516 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.598767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-797608-58-iscsi {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.598915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.599087 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.599241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.599394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.599573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.599844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.600013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.600167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.600319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.600487 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.600606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.600695 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.600775 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.600975 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.601047 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.601232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.601362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.601515 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.601643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.601836 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.601985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.602149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.602317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.602474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.602643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.602811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.602979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.603141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.603260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.603474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.603573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.603665 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.603761 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.603996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.604122 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.604276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.604439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.604671 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.604850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-797608-58-iscsi {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.605020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.605175 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.605340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.605434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.605675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.605800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.605967 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.606070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.606266 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.606456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.606622 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.606791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.606951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.607110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.607264 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.607418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.607571 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.607738 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.607895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.608041 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.608188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.608354 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.608522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.608670 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.608817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.608971 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.609119 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.609273 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.609429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.609583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.609933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.610095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.610244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.610389 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.610574 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.610923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.611085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.611085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.612145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.612145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.612442 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.612605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.612840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.613083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.613328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.613783 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.613998 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.614177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.614347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.615104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.615299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.615463 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.615619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.615784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.616134 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.616290 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.616454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.616612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.616782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.616939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.617095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.617095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.617381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.617535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.617716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.617716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.618034 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.618034 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.618317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.618474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.618620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.618791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.618939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.619084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.619238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.619384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.619536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.619697 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.619843 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.619988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.620142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.620297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.71 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.620449 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.620613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.71 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.620777 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.620930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.620930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.621227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.621380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.621543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.621543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.621884 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.622046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.622199 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.622361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.622524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.622689 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.622842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.622994 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.623147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.623308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.623469 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.623621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.623810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.623965 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.624117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.624280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.624434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.624594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.624759 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.624912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.625082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.625354 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.625540 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.625742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.625912 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.626259 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.626430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.626592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.626746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.626909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.626909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.627221 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.627388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.627542 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.627694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.627847 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.628001 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.628154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.628326 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.628490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.628652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.628813 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.628813 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.629104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.629284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.629437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.629600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.629600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.629939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.630298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.630298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.630619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.630780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.630780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.631082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.631245 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.631410 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.631563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.631563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.631872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.632025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.632025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.632325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.632478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.632640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.632802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.632802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.633110 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.633273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.633273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.633594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.634162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.634323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.634323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.634636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.634790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.634790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.634790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.635351 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.635351 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.636023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.636618 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.636850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.637008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.637161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.637325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.637478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.637641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.637926 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.638095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.638095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.638506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.638776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.638776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.639296 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.639569 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.639761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.639915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.639915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.640217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.640217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.640217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.640217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.640821 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.641095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.641433 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.641795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.642117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.642437 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.642768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 18 14:18:17.643118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.644278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.644278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.644278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.644975 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.644975 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.645458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.645458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.646249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.646793 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.647035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.647289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.647289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.647754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.648000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.648229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.648501 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.648728 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.648894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.649049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.649268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.649427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.649618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.649814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.649971 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.650124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.650276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.650438 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.650605 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.650759 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.650919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651074 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.651996 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.652151 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.652315 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.652494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.652494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.652792 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.652952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.653105 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.653105 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.653405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.653575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.653780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.653780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.654086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.654256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.654419 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.654581 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.654581 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.654871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655038 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655345 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655659 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.655982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.656413 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.656575 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.656921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.657081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.657249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.657411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.657564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.658432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.658608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.658792 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.658961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.658961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.659802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.659968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.660132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.660132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.660447 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.660602 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.660763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.660916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.661076 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.661268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.661268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.661591 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.661811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.661978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.662142 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.662311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.662474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.662636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.662790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.662951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.663112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.663280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.663434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.663434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.663748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.663900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.664061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.664225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.664387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.664578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.664744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.664897 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.665078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.665294 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.665457 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.665625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.665625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.665625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.666107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.666261 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.666442 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.666722 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.667083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.667244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.667244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.667548 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.667710 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.667873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.668037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.668207 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.668372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.668526 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.668686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.668848 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.669002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.669183 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.669397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.669397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.669397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.669893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.670057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.670235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.670399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.670568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.670722 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.670884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671208 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671363 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671363 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671660 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.671982 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.672147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.672308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.672462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.672462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.672762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673006 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673006 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673309 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.673953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.674903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.675488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.675655 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.675825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.675978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.675978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.675978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.676426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.676589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.676589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.677251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.677414 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.677576 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.677769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.677769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.678094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.678253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.678253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.678561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.678726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.678896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679051 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679051 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679495 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679657 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679657 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.679958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.680256 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.680256 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.680703 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.680871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.681026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.681026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.681327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.681491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.681681 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.681853 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682505 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682668 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682841 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.682995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.683148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.683300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.683504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.683779 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.684045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.684321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.684321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.684785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.684785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.685266 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.685439 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.685608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.685838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.686067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.686259 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.686259 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.686564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.686718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.686878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.687032 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.687504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.687666 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.687819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688004 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688173 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688506 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688668 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.688984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.689137 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.689300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.689462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.689616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.689807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.689964 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.690116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.690289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.690443 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.690604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.690604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.690913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.691082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.691245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.691407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.691561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.691561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.691852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.692012 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.692185 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.692338 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.692524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.692684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.692838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.693002 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.693164 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.693164 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.693600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.693806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.693975 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.694144 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.694299 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.694463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.694463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.694763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.694917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.695081 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.695235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.695396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.695548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.695744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.696013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.696232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.696391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.696544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.696739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.696905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.697070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.697580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.697793 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.697952 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.697952 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.698266 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.698429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.698583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.698737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.698890 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.699042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.699205 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.699375 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.699529 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.699682 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.699854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.700078 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.700237 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.700401 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.700556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.700718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.700872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.701024 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.701187 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.701362 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.701516 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.701705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.701864 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.702018 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.702190 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.702354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.702508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.702660 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.702872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.703037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.703211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.703378 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.703538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.703699 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.703859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.704013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.704181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.704335 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.704497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.704659 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.704908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.705084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.705239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.705489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.705702 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.706730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.707008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.707298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.707850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.708016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.708016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.708390 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.708604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.708782 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.709022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.709274 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.709534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.709915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.709915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.709915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.710571 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.710737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.710892 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.711044 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.711209 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.711371 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.711525 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.711743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.711743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.712264 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.712519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.712767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.713015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.713015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.713461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.713722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.713986 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.714224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.714224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.714706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.714951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.715368 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.715641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.715883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.716133 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.716397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.716397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.716856 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.717109 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.717348 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.717589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.718339 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.718586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.718586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.719052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.719325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.719565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.719742 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.719900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.720076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.720076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.720378 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.720548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.720548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.720850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.721013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.721167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.721330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.721510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.721695 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.721857 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722011 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.722980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.723133 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.723294 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.723469 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.723632 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.723857 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.724103 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.724339 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.724522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.724824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.724994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.725149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.725312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.725716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.725902 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.726078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.726241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.726395 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.726549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.726549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.726867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.727022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.727022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.727321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.727484 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.727654 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.727817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.728216 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.728522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.728691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.728853 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729326 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.729956 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.730110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.730271 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.730436 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.730598 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.730775 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.730775 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.731065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.731226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.731396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.731564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.731719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.731872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732025 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732512 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.732999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.733161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.733330 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.733485 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.733639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.733832 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.733994 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.734205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.734379 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.734544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.734544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.734835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.734997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.735150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.735317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.735317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.735616 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.735822 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.735981 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.736144 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.736307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.736468 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.736632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.736785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.736785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.737100 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.737254 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.737254 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.737552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.737749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.737909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.738099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.738471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.738471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.738941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.739109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.739272 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.739272 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.739272 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.740270 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.740437 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.740600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.740843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741001 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741156 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741156 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741447 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.741973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742453 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.742940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.743240 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.743393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.743557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.743729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.743892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.744046 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.744209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.744373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.744536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.744691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.744844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.745007 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.745168 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.745332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.745332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.745633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.745850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746484 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.746936 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.747098 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.747267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.747444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.747599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.747751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.747924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748086 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.748621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.749512 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.749696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.749857 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750024 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750178 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750646 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.750961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.751114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.751114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.751415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.751570 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.751570 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.751871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.752024 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.752203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.752357 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.752519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.752674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.752838 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.753000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.753163 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.753325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.753486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.753640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.753922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.754194 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.754472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.754768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.755040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.755284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.755528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.755753 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.755926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.756082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.756235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.756397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.756559 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.756728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.756883 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.757046 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.757220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.757375 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.757537 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.757731 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.757902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.758066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.758229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.758229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.758551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.758921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.759114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.759407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.759576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.759742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.759960 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.759960 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.760266 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.760427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.760588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.760751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.760919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.761075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.761236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.761392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.761392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.761717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.761895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.762049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.762211 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.762374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.762528 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.762690 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.762854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.763974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.764165 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.764325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.764478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.764652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.764818 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.764972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765126 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765598 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.765980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.766273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.766439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.766604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.766789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.767042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.767277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.767458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.767628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.767790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.767790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.768103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.768267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.768429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.768608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.768782 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.769153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.769307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.769613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.769613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.769613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.770091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.770091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.770537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.770537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.770916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.770916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.771381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.772255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.772409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.772409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.772800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.772957 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.775647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.775829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.775829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.776136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.776315 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.776482 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.776637 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.776792 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.776955 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.777121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.777290 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.777445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.777599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.777782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.777782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.778108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.778264 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.778425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.778588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.778753 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.778909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.779239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.779423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.779423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.780109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.780409 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.780858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.781144 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.781311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.781477 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.781639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.781639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.781639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.782113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.782267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.782267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.782267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.782737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.782902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783535 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783689 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.783852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.784155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.784309 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.784483 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.784644 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.784811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.784973 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.785147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.785302 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.785456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.785619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.785871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.786078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.786267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.786437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.786600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.786779 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.786943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.787105 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.787267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.787429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.787591 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.787756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.787911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788228 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788502 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788758 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.788924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789008 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789096 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789199 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789285 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789597 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789597 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789757 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789830 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789901 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.789987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790357 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790439 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.790694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791010 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791469 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791622 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791846 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.791928 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.792010 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.792377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.792474 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.792812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.793099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.793180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.793430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.793521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.794743 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.794932 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.795097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.795260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.795415 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.795576 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.795730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.795893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.796056 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.796218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.796381 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.796543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.796698 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.796698 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.797011 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.797173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.797326 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.797489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.797682 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.797846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798011 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798642 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.798804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.799134 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.799292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.799445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.799608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.799762 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.799916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.800079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.800350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.800626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.800785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.800949 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.801113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.801275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.801437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.801605 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.801783 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.802023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.802193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.802453 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.802630 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.802795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.802951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.803115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.803115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.803428 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.803593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.803593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.803893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.804058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.804222 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.804375 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.804375 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.804769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.804769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117767) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:18:17.805080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.805080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.805080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.805080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.805729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.805729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.806048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.806354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.806668 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.806986 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.807306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.807617 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.807930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.808248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.808566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.808898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.809237 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.809562 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.809951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.810255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.810598 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.811145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.811465 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.811803 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.812644 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.812644 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.812982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.813146 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.813386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.813745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.814039 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.814355 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.814669 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.814979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.815306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.815621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.815930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.816248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.816559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.817111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.817549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.817985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.818362 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.818703 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.819029 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.819347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.819683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.820153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.820332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.820636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.820953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.821265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.821580 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.821984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.822235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.822656 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.822869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.823181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.823565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.823830 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.824142 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.824452 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.824769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.825079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.825387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.825732 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.826049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.826407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.826674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.826991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.827300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.827724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.827921 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.828235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.828603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.828940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.829254 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.829566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.829924 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.830346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.830573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.830893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.831209 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.831569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.831893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.832596 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.832885 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.833237 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.833752 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.834108 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.834292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.834560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.834870 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.835203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.835523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.835836 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.836151 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.836563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.836778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.837096 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.837407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.837909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.838094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.838365 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.838680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.838996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.839309 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.839633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.839997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.840329 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.840652 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.840955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.841274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.841588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.841936 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.842322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.842563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.842883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.843211 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.844075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.844075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.844385 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.844539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.844865 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.845191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.845529 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.845879 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.846210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.846569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.846875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.847148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.847484 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.847829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.848235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.848481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.848823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.849137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.849449 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.849831 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.850123 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.850443 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.850791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.851101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.851417 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.851766 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.852240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.852633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.853303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.853545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.854059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.854345 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.854766 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.855149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.855533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.855921 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.856319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.856737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.857070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.857447 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.857945 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.858411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.858648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.859291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.859450 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.859843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.860240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.860648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.861233 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.861392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.861758 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.862094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.862413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.862763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.863088 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.863406 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.863728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.864046 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.865030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.865030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.865374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.865742 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.866060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.866397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.866718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.867108 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.867372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.867686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.868092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.868339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.868659 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.868970 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.869286 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.869631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.869958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.870273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.870586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.870915 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.871235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.871574 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.871904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.872217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.872549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.872882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.873253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.873557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.873980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.874277 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.874699 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.874914 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.875227 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 18 14:18:17.875473 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117766) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 18 14:18:17.960431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Registered counter for database nova_api Jul 18 14:18:17.984758 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:17.994713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.028161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Registered counter for database nova_api Jul 18 14:18:18.049486 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.055443 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.context [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d09de4-139b-4035-8793-feb7f7782efc(cell1) {{(pid=117767) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 14:18:18.057293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.059478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:18.061095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:18.061944 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:18.063939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:18.066043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Registered counter for database nova_cell0 Jul 18 14:18:18.070784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Registered counter for database nova_cell1 Jul 18 14:18:18.077985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.081418 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.085902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.088572 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.115730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.context [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),31d09de4-139b-4035-8793-feb7f7782efc(cell1) {{(pid=117766) load_cells /opt/stack/nova/nova/context.py:464}} Jul 18 14:18:18.119814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:18.121468 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:18.122335 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:18:18.124348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:18:18.126471 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Registered counter for database nova_cell0 Jul 18 14:18:18.130827 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Registered counter for database nova_cell1 Jul 18 14:18:18.139074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.139800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.146716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.148216 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.234408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO dbcounter [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Registered counter for database nova_cell0 Jul 18 14:18:18.242381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_db.sqlalchemy.engines [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117767) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.247757 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writer thread running {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.295160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO dbcounter [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Registered counter for database nova_cell0 Jul 18 14:18:18.305555 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117766) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 18 14:18:18.312593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writer thread running {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 18 14:18:18.576789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:18:18.584272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:18:18.631875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:18:18.641817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:18:18.932226 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:18:18.938604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: WARNING keystonemiddleware.auth_token [None req-bd5b117e-ab2c-4d79-b569-23c1f2c14c2b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:18:18.944763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5596909b69c0 pid: 117767 (default app) Jul 18 14:18:19.021627 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 18 14:18:19.028787 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: WARNING keystonemiddleware.auth_token [None req-d9b665a6-1f99-4762-a4b2-bc402020ecf2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 18 14:18:19.034860 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5596909b69c0 pid: 117766 (default app) Jul 18 14:19:00.381468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.382603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.383710 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:00.384951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:01.381448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:01.382629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:01.383366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:01.386315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:02.284017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c59b4420-0bfc-4a93-9638-e20aa0585a8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Action: 'create', calling method: .version_select at 0x7fb53c1e8820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-735933163"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:02.706589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5f4940ef-a53e-4e18-a529-28fd4c650f88 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Action: 'create', calling method: .version_select at 0x7fb53c1e88b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1219472654", "metadata": {"Type": "work"}}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:04.047785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c59b4420-0bfc-4a93-9638-e20aa0585a8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.679115 Jul 18 14:19:04.056704 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 1/1] 10.222.0.71 () {60 vars in 1154 bytes} [Mon Jul 18 14:19:00 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3689 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 14:19:04.064872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3f427a64-7a03-4e7e-b723-5de1f153e5c0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0b4670>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:04.168347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5f4940ef-a53e-4e18-a529-28fd4c650f88 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 2.794121 Jul 18 14:19:04.168941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 1/2] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 18 14:19:01 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 2796 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 18 14:19:04.181805 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ccc04556-c53f-411b-b421-e6ce853be825 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Calling method '.version_select at 0x7fb53c0b2700>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:04.269160 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3f427a64-7a03-4e7e-b723-5de1f153e5c0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 200 len: 344 microversion: 2.1 time: 0.210940 Jul 18 14:19:04.275385 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 2/3] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:04 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 344 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:04.359867 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ccc04556-c53f-411b-b421-e6ce853be825 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f" status: 200 len: 353 microversion: 2.1 time: 0.182510 Jul 18 14:19:04.360658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 2/4] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:04 2022] GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f => generated 353 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:05.282654 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-330980d4-b9b3-4c84-a3f3-45177bab2533 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0b4790>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:05.376173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2f21ac8d-b630-45fe-be79-df9d322b0d24 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Calling method '.version_select at 0x7fb53c0b28b0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:05.446842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-330980d4-b9b3-4c84-a3f3-45177bab2533 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 200 len: 345 microversion: 2.1 time: 0.167941 Jul 18 14:19:05.448790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 3/5] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:05 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 345 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:05.467910 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cc00097c-bbd6-47b1-b34a-fa00007d676f tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Action: 'create', calling method: .version_select at 0x7fb53c0b4d30>, body: {"snapshot": {"volume_id": "4b0cd9ba-e098-4bb1-a2b3-73a220dced4d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-869093879"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:05.514444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2f21ac8d-b630-45fe-be79-df9d322b0d24 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f" status: 200 len: 354 microversion: 2.1 time: 0.145758 Jul 18 14:19:05.515008 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 3/6] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:05 2022] GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:05.534538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e98847ed-fac0-451c-9534-23a61a69a039 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Calling method '.version_select at 0x7fb53c0b2e50>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:05.701523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e98847ed-fac0-451c-9534-23a61a69a039 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f" status: 200 len: 354 microversion: 2.1 time: 0.173277 Jul 18 14:19:05.702920 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 4/7] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:05 2022] GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f => generated 354 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:05.741075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-131869a6-fdd5-48af-9c97-d9cdfafdb53e tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Calling method '.version_select at 0x7fb53c0c9550>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:05.952451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-131869a6-fdd5-48af-9c97-d9cdfafdb53e tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f" status: 202 len: 0 microversion: 2.1 time: 0.224212 Jul 18 14:19:05.954949 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 5/8] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:19:05 2022] DELETE /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:19:05.980396 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ccc1559e-108c-42a5-a000-a1f99ffe0f25 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Calling method '.version_select at 0x7fb53c0b2d30>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.455816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cc00097c-bbd6-47b1-b34a-fa00007d676f tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.992198 Jul 18 14:19:06.456521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 4/9] 10.222.0.71 () {60 vars in 1161 bytes} [Mon Jul 18 14:19:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:06.469217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0542aa02-a3a9-4a31-93b9-fadd5f744f94 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0cb9d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.483383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-ccc1559e-108c-42a5-a000-a1f99ffe0f25 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] HTTP exception thrown: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ccc1559e-108c-42a5-a000-a1f99ffe0f25 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Request method failure captured: Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f HTTP/1.1 Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvV0Itk1J4Oi-Z_BXv2JUaMnYXfW2cU4X_VwFLYz7-Br_IW73Y6B3Csypem-OLy_zUom4-d2X-ooAPA02FB-ACIZSts9qpbF0EjgcV-nybMDFOBxkOwVpyCLm5LD6eDwZTR4wNMEr3xBkFpMLaWV1ilmoc1tRir46DaH4pWgz7MUEc Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: c4a9a9a51d7c4f7189bb934897f2c21a Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesGetTestJSON-660361290 Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:19:06.490155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c4a9a9a51d7c4f7189bb934897f2c21a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c4a9a9a51d7c4f7189bb934897f2c21a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c4a9a9a51d7c4f7189bb934897f2c21a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c4a9a9a51d7c4f7189bb934897f2c21a", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesGetTestJSON-660361290 Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: c4a9a9a51d7c4f7189bb934897f2c21a Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesGetTestJSON-660361290 Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesGetTestJSON-660361290-project Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: b2306856ff3a4ad7addd8f8a6c0be45d Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesGetTestJSON-660361290-project Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '00412495-5b97-4c78-9032-4fc9cdbd391f'} Jul 18 14:19:06.491339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. (HTTP 404) (Request-ID: req-3b4e374b-3b21-4d11-a96d-be0fc7e8f4bb) Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.491987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:06.492911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:19:06.494138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. Jul 18 14:19:06.495421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:06.496040 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ccc1559e-108c-42a5-a000-a1f99ffe0f25 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] Returning 404 to user: Volume 00412495-5b97-4c78-9032-4fc9cdbd391f could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:06.499324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ccc1559e-108c-42a5-a000-a1f99ffe0f25 tempest-VolumesGetTestJSON-660361290 tempest-VolumesGetTestJSON-660361290-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f" status: 404 len: 109 microversion: 2.1 time: 0.537551 Jul 18 14:19:06.499896 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 6/10] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:05 2022] GET /compute/v2.1/os-volumes/00412495-5b97-4c78-9032-4fc9cdbd391f => generated 109 bytes in 540 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:06.554544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0542aa02-a3a9-4a31-93b9-fadd5f744f94 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 286 microversion: 2.1 time: 0.089748 Jul 18 14:19:06.555254 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 5/11] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:06 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:06.571731 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-156d1c5e-8d92-4d74-b000-2b4d4e9e8e38 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53ca96a60>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.677115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-156d1c5e-8d92-4d74-b000-2b4d4e9e8e38 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.114321 Jul 18 14:19:06.677974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 7/12] 10.222.0.71 () {58 vars in 1139 bytes} [Mon Jul 18 14:19:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:06.691268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4e96209d-65e7-4698-8e81-866b0b1e6e74 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0b4ca0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:06.776836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4e96209d-65e7-4698-8e81-866b0b1e6e74 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 286 microversion: 2.1 time: 0.090661 Jul 18 14:19:06.777638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 6/13] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:06 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:07.790251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-345bcdde-8e42-451d-8b31-190d6a87a744 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c02f5e0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:07.862063 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-345bcdde-8e42-451d-8b31-190d6a87a744 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 286 microversion: 2.1 time: 0.076908 Jul 18 14:19:07.863026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 8/14] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:07 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:08.875788 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0c8ce1d-0f17-4f89-a022-08608e2c4113 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0b49d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:08.978969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e0c8ce1d-0f17-4f89-a022-08608e2c4113 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 286 microversion: 2.1 time: 0.108279 Jul 18 14:19:08.980319 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 7/15] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:08 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:09.993205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e4660620-e5e8-4946-ac56-1dcad6b98d3a tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c02fd30>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:10.104451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e4660620-e5e8-4946-ac56-1dcad6b98d3a tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 286 microversion: 2.1 time: 0.116786 Jul 18 14:19:10.105682 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 9/16] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:09 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 286 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:11.117855 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8fac0633-8cde-4521-940b-2fa21cc6c368 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0cb790>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:11.199074 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8fac0633-8cde-4521-940b-2fa21cc6c368 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 287 microversion: 2.1 time: 0.086428 Jul 18 14:19:11.200179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 8/17] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:11 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 287 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:11.211011 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e71b70d-3308-4c8a-af47-af6c3e2c2e09 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c032430>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:11.510226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8e71b70d-3308-4c8a-af47-af6c3e2c2e09 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "DELETE /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 202 len: 0 microversion: 2.1 time: 0.302843 Jul 18 14:19:11.511516 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 10/18] 10.222.0.71 () {58 vars in 1253 bytes} [Mon Jul 18 14:19:11 2022] DELETE /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:19:11.521463 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-138d5d99-6610-4947-a950-c167c54800ce tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0cb0d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:11.616209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-138d5d99-6610-4947-a950-c167c54800ce tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 200 len: 286 microversion: 2.1 time: 0.099281 Jul 18 14:19:11.618592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 9/19] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:11 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 286 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:12.631486 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f5218efd-ccfc-4a0e-bda8-c4624982c7aa tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c02fa60>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:12.701890 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-f5218efd-ccfc-4a0e-bda8-c4624982c7aa tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] HTTP exception thrown: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f5218efd-ccfc-4a0e-bda8-c4624982c7aa tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Request method failure captured: Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 HTTP/1.1 Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvU8DdBxxs2aM98wglAi38Mm2pB_jZSiVD8hDuoFMdnuoPBzDMUDEF2SbEYvO6MwKy3Hp64SyxZ0KxXttGKUvOzEGA8zxNoGybmRx-I_JOIRWoQS0PLIb9u32PQPMrpL7wWC8yg52qPuu1crKKuBpyXFv9HA_IltthmL6mRbWpWt9w Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:19:12.704387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c64ef5c9e4e74877afbe0b977348706e", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 93f4adb167914e1b82542cbd87f3f214 Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'a5b731b4-1023-4195-b2f4-fbd57c62de01'} Jul 18 14:19:12.705552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. (HTTP 404) (Request-ID: req-5e78f903-1223-4272-b68b-e89cccea0ea0) Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.706297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:12.707218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 18 14:19:12.708147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. Jul 18 14:19:12.709066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:12.712388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f5218efd-ccfc-4a0e-bda8-c4624982c7aa tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Returning 404 to user: Snapshot a5b731b4-1023-4195-b2f4-fbd57c62de01 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:12.713466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f5218efd-ccfc-4a0e-bda8-c4624982c7aa tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01" status: 404 len: 111 microversion: 2.1 time: 0.087998 Jul 18 14:19:12.714560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 11/20] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:19:12 2022] GET /compute/v2.1/os-snapshots/a5b731b4-1023-4195-b2f4-fbd57c62de01 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:12.723589 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-91f5880f-983a-4c7e-9a9e-22049ed95608 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0cb160>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:12.877248 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-91f5880f-983a-4c7e-9a9e-22049ed95608 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 202 len: 0 microversion: 2.1 time: 0.158593 Jul 18 14:19:12.877914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 10/21] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:19:12 2022] DELETE /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:19:12.888015 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0b91be17-fbd2-4ca8-9cab-fef8d1b6e0e6 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0b2ca0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:13.007896 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0b91be17-fbd2-4ca8-9cab-fef8d1b6e0e6 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 200 len: 344 microversion: 2.1 time: 0.125181 Jul 18 14:19:13.009190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 12/22] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:12 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 344 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:14.024957 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-941eaa7e-005a-49f7-995f-ee13200cd3d1 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0cb8b0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:14.166482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-941eaa7e-005a-49f7-995f-ee13200cd3d1 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 200 len: 344 microversion: 2.1 time: 0.148825 Jul 18 14:19:14.167067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 11/23] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:14 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 344 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:15.181181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4d3e2182-0571-4233-ba6d-f1cdaa29820b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c12d4c0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:15.353150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4d3e2182-0571-4233-ba6d-f1cdaa29820b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 200 len: 344 microversion: 2.1 time: 0.177671 Jul 18 14:19:15.353759 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 13/24] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:15 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 344 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:16.368796 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bdbcf9a4-24df-428e-acb5-9b8721d77fd0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c0b4940>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:16.477015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-bdbcf9a4-24df-428e-acb5-9b8721d77fd0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] HTTP exception thrown: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bdbcf9a4-24df-428e-acb5-9b8721d77fd0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Request method failure captured: Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d HTTP/1.1 Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvU8DdBxxs2aM98wglAi38Mm2pB_jZSiVD8hDuoFMdnuoPBzDMUDEF2SbEYvO6MwKy3Hp64SyxZ0KxXttGKUvOzEGA8zxNoGybmRx-I_JOIRWoQS0PLIb9u32PQPMrpL7wWC8yg52qPuu1crKKuBpyXFv9HA_IltthmL6mRbWpWt9w Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:19:16.499086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c64ef5c9e4e74877afbe0b977348706e", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 93f4adb167914e1b82542cbd87f3f214 Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '4b0cd9ba-e098-4bb1-a2b3-73a220dced4d'} Jul 18 14:19:16.500094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. (HTTP 404) (Request-ID: req-e944bf71-cc15-48e3-bcef-13cac8a0b9f5) Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.500699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:16.501562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:19:16.502451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bdbcf9a4-24df-428e-acb5-9b8721d77fd0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Returning 404 to user: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:16.503292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bdbcf9a4-24df-428e-acb5-9b8721d77fd0 tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 404 len: 109 microversion: 2.1 time: 0.138356 Jul 18 14:19:16.515850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 12/25] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:16 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:16.534435 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c625a790-0003-44aa-a42b-44b86c7a001c tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c02ff70>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:16.675511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-c625a790-0003-44aa-a42b-44b86c7a001c tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] HTTP exception thrown: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c625a790-0003-44aa-a42b-44b86c7a001c tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Request method failure captured: Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d HTTP/1.1 Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvU8DdBxxs2aM98wglAi38Mm2pB_jZSiVD8hDuoFMdnuoPBzDMUDEF2SbEYvO6MwKy3Hp64SyxZ0KxXttGKUvOzEGA8zxNoGybmRx-I_JOIRWoQS0PLIb9u32PQPMrpL7wWC8yg52qPuu1crKKuBpyXFv9HA_IltthmL6mRbWpWt9w Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:19:16.679105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c64ef5c9e4e74877afbe0b977348706e", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 93f4adb167914e1b82542cbd87f3f214 Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '4b0cd9ba-e098-4bb1-a2b3-73a220dced4d'} Jul 18 14:19:16.680312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. (HTTP 404) (Request-ID: req-dec3e86a-4639-4967-807d-b641a8d7b607) Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.680927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:19:16.681876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 14:19:16.682747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c625a790-0003-44aa-a42b-44b86c7a001c tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Returning 404 to user: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c625a790-0003-44aa-a42b-44b86c7a001c tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 404 len: 109 microversion: 2.1 time: 0.158575 Jul 18 14:19:16.683614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 14/26] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:19:16 2022] DELETE /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 109 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:16.696328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a2f8efe-dc50-42f5-ada4-51d31f1b3d8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Calling method '.version_select at 0x7fb53c035040>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:16.842442 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-2a2f8efe-dc50-42f5-ada4-51d31f1b3d8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] HTTP exception thrown: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a2f8efe-dc50-42f5-ada4-51d31f1b3d8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Request method failure captured: Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d HTTP/1.1 Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvU8DdBxxs2aM98wglAi38Mm2pB_jZSiVD8hDuoFMdnuoPBzDMUDEF2SbEYvO6MwKy3Hp64SyxZ0KxXttGKUvOzEGA8zxNoGybmRx-I_JOIRWoQS0PLIb9u32PQPMrpL7wWC8yg52qPuu1crKKuBpyXFv9HA_IltthmL6mRbWpWt9w Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:19:16.846167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/c64ef5c9e4e74877afbe0b977348706e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_c64ef5c9e4e74877afbe0b977348706e", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: c64ef5c9e4e74877afbe0b977348706e Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-420371881 Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 93f4adb167914e1b82542cbd87f3f214 Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotsTestJSON-420371881-project Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '4b0cd9ba-e098-4bb1-a2b3-73a220dced4d'} Jul 18 14:19:16.848084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. (HTTP 404) (Request-ID: req-c457b15f-e46f-4b1a-8907-f59017ee7135) Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.848824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:16.849863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:19:16.850807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a2f8efe-dc50-42f5-ada4-51d31f1b3d8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] Returning 404 to user: Volume 4b0cd9ba-e098-4bb1-a2b3-73a220dced4d could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:16.851712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2a2f8efe-dc50-42f5-ada4-51d31f1b3d8b tempest-VolumesSnapshotsTestJSON-420371881 tempest-VolumesSnapshotsTestJSON-420371881-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d" status: 404 len: 109 microversion: 2.1 time: 0.159732 Jul 18 14:19:16.863905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 13/27] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:16 2022] GET /compute/v2.1/os-volumes/4b0cd9ba-e098-4bb1-a2b3-73a220dced4d => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:18.793460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2227ad8a-b30c-4814-aed6-b1a63ac2a54e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'create', calling method: .version_select at 0x7fb53c0b28b0>, body: {"keypair": {"name": "tempest-keypair-2091530357", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJHHEmaaFzeAO+g7S6KPmED/ZQDOafbFo5ief9wrctd6rMkbRyiiSNMdzrBIYBryRnFrYRJuUXTmPCTeD6YOhHU7caENR+vfRf41UrB+enjvh0aRazPpzTSvqD5k8UJPLA=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:18.865361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2123603800", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "networks": [{"uuid": "48d1049f-8f37-43ea-8510-b88879f7e86f"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:18.941113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-2227ad8a-b30c-4814-aed6-b1a63ac2a54e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:18.960671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-2227ad8a-b30c-4814-aed6-b1a63ac2a54e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for user 3aab24bab8d74b7aa5a20e7b2b89b5d7 and project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:19.117701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2227ad8a-b30c-4814-aed6-b1a63ac2a54e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.793112 Jul 18 14:19:19.119961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 15/28] 10.222.0.71 () {62 vars in 1199 bytes} [Mon Jul 18 14:19:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 799 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 18 14:19:19.274379 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] validate_networks() for [('48d1049f-8f37-43ea-8510-b88879f7e86f', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:22.991515 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-118f6e60-fe2f-4747-8a40-492a1926d80e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: .version_select at 0x7fb53bff7790>, body: {"keypair": {"name": "tempest-keypair-529814000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCfz8JCXEqrA0IutTMVrhYjUUwEJ5kaWdh+wnR+tcO9whU2KwXP5eCjW1ExBPsSSO/okH+Zm7qomgE2Lw3H5iQk0Z8hNCN3Ek3u1i3SSxecZzE3zhlxysZzE7N+oeGgAZQ=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:23.024674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-118f6e60-fe2f-4747-8a40-492a1926d80e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:23.035112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-118f6e60-fe2f-4747-8a40-492a1926d80e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:23.047305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:23.047901 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:23.049832 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:23.050489 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:23.051246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:23.088549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-118f6e60-fe2f-4747-8a40-492a1926d80e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.033742 Jul 18 14:19:23.090612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 16/29] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:19:22 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:23.103220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:23.103664 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:23.104452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:23.104879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:23.175766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Getting quotas for project 8788b8d25f234df6895ea3f8fa046610. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:23.204415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Getting quotas for user 2e3c7eb6a5cb4515b6f48520535fea76 and project 8788b8d25f234df6895ea3f8fa046610. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:23.242088 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:23.247787 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-685129697", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:23.249680 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:23.469642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-577fcc62-97a6-46cf-80f4-993c86d411bb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.093588 Jul 18 14:19:23.470925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 14/30] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 5095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 14:19:23.485343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-67e17d0f-2e2c-44c5-b061-e593e748731f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:23.491082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-67e17d0f-2e2c-44c5-b061-e593e748731f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:23.535485 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] validate_networks() for [('e42702a6-2b2a-4d0a-b877-a03ffd658d9e', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:24.027397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67e17d0f-2e2c-44c5-b061-e593e748731f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:24.050095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-67e17d0f-2e2c-44c5-b061-e593e748731f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1215 microversion: 2.1 time: 0.572459 Jul 18 14:19:24.054020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 15/31] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:23 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1215 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:19:24.722857 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8ca20191-fe4d-469d-ab5c-0bbaa8ff4b52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: .version_select at 0x7fb53b74f1f0>, body: {"keypair": {"name": "tempest-keypair-44830989", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8lwLdsJzEXtZlhP8VE17h7/Kw9x5dKLU/tn8u5myPmYJ2VntybHsr5oBgfkVebeJoGEOYDXMtFKjS7SzeF1FtiX8DN3rXKKmBxARHxMplcfbUFM3n+0fl9CXJQcUTeKQ=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:24.812314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-8ca20191-fe4d-469d-ab5c-0bbaa8ff4b52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:24.822192 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-8ca20191-fe4d-469d-ab5c-0bbaa8ff4b52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for user 5ca8be8093b547ee953ea646f90fdcae and project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:24.917280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8ca20191-fe4d-469d-ab5c-0bbaa8ff4b52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.862089 Jul 18 14:19:24.917936 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 16/32] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:19:24 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:25.068969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e999e2c0-22dd-4135-85f8-c983d9399b92 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:25.069603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e999e2c0-22dd-4135-85f8-c983d9399b92 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:25.500862 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e999e2c0-22dd-4135-85f8-c983d9399b92 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:25.509647 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e999e2c0-22dd-4135-85f8-c983d9399b92 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1215 microversion: 2.1 time: 0.445680 Jul 18 14:19:25.514721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 17/33] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:25 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1215 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:26.094587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-515809045", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb202500-3bef-40aa-b87d-ae6d50c664ee"}], "security_groups": [{"name": "tempest-securitygroup--1951821534"}], "key_name": "tempest-keypair-2091530357", "user_data": "}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:27.023799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] validate_networks() for [('cb202500-3bef-40aa-b87d-ae6d50c664ee', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:28.043727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:28.045480 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:28.046568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:28.047279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:28.047919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:28.062055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.062879 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:28.063918 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.064973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:28.137169 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:28.156991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for user 8a45cafadb824e08bd9e86fd0d5c4c71 and project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:28.189595 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:28.203223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:28.371348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3f1d2964-5d8d-4ed1-bdee-e34980f397e8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.278708 Jul 18 14:19:28.372004 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 17/34] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:19:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 5281 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:19:28.382401 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:28.383039 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:28.416689 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.417072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:28.420837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:28.421407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:29.370663 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:29.405368 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bf82cb6e-c76f-4e30-a8b9-eb48189b6bb9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1267 microversion: 2.1 time: 1.031698 Jul 18 14:19:29.418968 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 18/35] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:28 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1267 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:29.433451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-676debbc-8dfe-46cb-bc52-98e2e0117b34 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a672ee0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:29.602744 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-676debbc-8dfe-46cb-bc52-98e2e0117b34 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/bf817056-eafd-4abe-b604-b1a443e22dae" status: 200 len: 350 microversion: 2.1 time: 0.182376 Jul 18 14:19:29.603549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 19/36] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:29 2022] GET /compute/v2.1/os-volumes/bf817056-eafd-4abe-b604-b1a443e22dae => generated 350 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:29.616576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bd77fb07-4135-4b72-9540-5fc25004c877 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:29.617439 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bd77fb07-4135-4b72-9540-5fc25004c877 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:29.929890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:29.930730 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:29.931544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:29.932696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:29.933307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:29.977958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:29.986232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:29.987640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:29.989750 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:30.088310 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:30.095788 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for user 3aab24bab8d74b7aa5a20e7b2b89b5d7 and project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:30.119105 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:30.121276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bd77fb07-4135-4b72-9540-5fc25004c877 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.122084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:30.187028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bd77fb07-4135-4b72-9540-5fc25004c877 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1221 microversion: 2.1 time: 0.575369 Jul 18 14:19:30.190611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 20/37] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:29 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1221 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:30.340350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fd71ea82-b232-4310-8d5d-3362047097c1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.252167 Jul 18 14:19:30.348079 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 18/38] 10.222.0.71 () {62 vars in 1187 bytes} [Mon Jul 18 14:19:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 4263 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 14:19:30.357032 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-deddcbf2-d71d-4a95-8943-82293ecc0cc1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:30.357650 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-deddcbf2-d71d-4a95-8943-82293ecc0cc1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:30.447824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:30.454335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:30.495900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:30.502658 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:30.511143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:30.514463 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:30.549916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-deddcbf2-d71d-4a95-8943-82293ecc0cc1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.561776 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-deddcbf2-d71d-4a95-8943-82293ecc0cc1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.569465 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-deddcbf2-d71d-4a95-8943-82293ecc0cc1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:30.572084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-deddcbf2-d71d-4a95-8943-82293ecc0cc1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1281 microversion: 2.20 time: 0.219300 Jul 18 14:19:30.585638 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 21/39] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:30 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1281 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:30.601992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1520720724", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c89027a-566a-4914-8ad9-bb014d7b4afd"}], "security_groups": [{"name": "tempest-securitygroup--1222915026"}], "key_name": "tempest-keypair-529814000", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:30.987106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] validate_networks() for [('6c89027a-566a-4914-8ad9-bb014d7b4afd', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:31.325705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:31.360529 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e0347988-91d6-4afe-ae0b-e78648b60345 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1273 microversion: 2.1 time: 0.919630 Jul 18 14:19:31.364822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 19/40] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:30 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1273 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:31.379532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1216130821", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:31.560227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] validate_networks() for [('e42702a6-2b2a-4d0a-b877-a03ffd658d9e', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:34.476455 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:34.477135 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:34.478930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:34.479640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:34.480452 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:34.513517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:34.514063 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.519700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:34.522077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.588302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:34.626935 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:34.682101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:34.695847 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:34.819990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:34.822031 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:34.823165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:34.824078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:34.825626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:34.891528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:34.892626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.895509 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:34.897647 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:34.975823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:34.987804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for user 8a45cafadb824e08bd9e86fd0d5c4c71 and project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:34.995585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-07f85773-cd42-4d73-a2d2-ac82db9818fd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.416810 Jul 18 14:19:34.998881 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 22/41] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:19:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 4423 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:19:35.013539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:35.016916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:35.043836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:35.046433 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:35.056758 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.058635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.062337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.063528 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.257579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9ab51b6a-7111-4c97-950f-83546ff684c9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.890941 Jul 18 14:19:35.271645 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 20/42] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:19:31 2022] POST /compute/v2.1/servers => generated 383 bytes in 3906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:19:35.348845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-edc09ff6-d62c-403b-94d5-0f061872f760 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53c035700>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:35.586146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-edc09ff6-d62c-403b-94d5-0f061872f760 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/c29afa18-6190-4698-a487-8bc5a6a43c40" status: 200 len: 350 microversion: 2.1 time: 0.291692 Jul 18 14:19:35.587076 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 21/43] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:35 2022] GET /compute/v2.1/os-volumes/c29afa18-6190-4698-a487-8bc5a6a43c40 => generated 350 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:35.603878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:35.605039 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:35.619619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.622021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.624916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:35.626678 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:35.727811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:35.751205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:35.756783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:35.760036 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3c175096-3397-43da-a4be-e72bac0be7a8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1339 microversion: 2.20 time: 0.759588 Jul 18 14:19:35.763339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 23/44] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:34 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1339 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:35.782767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1098542374", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8c134e8-e1cb-4e62-935e-e3b599e00b1c"}], "security_groups": [{"name": "tempest-securitygroup--244555885"}], "key_name": "tempest-keypair-44830989", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:36.982513 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] validate_networks() for [('d8c134e8-e1cb-4e62-935e-e3b599e00b1c', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:19:37.078558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.092200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9a702bb2-6d41-49d6-8fce-4d3ede44d006 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 1.503581 Jul 18 14:19:37.101099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 22/45] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:35 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:37.106509 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:37.109995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:37.131921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.133008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.134159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.134843 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.290257 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.307641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0c6c6e4e-3d72-49d5-9da2-c9365736c77d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1245 microversion: 2.1 time: 0.204841 Jul 18 14:19:37.326468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 23/46] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:37 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1245 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:37.353531 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:37.355672 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:37.382721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.384066 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.385129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.385815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.725608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:37.751883 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e504178f-8e2a-4ab9-b6dc-069c38042937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1226 microversion: 2.1 time: 0.421715 Jul 18 14:19:37.752628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 24/47] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:37 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1226 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:37.774705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:37.778599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:37.828030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.835760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:37.847213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:37.861629 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:38.485473 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:38.502320 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:38.521361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:38.523042 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-26ec741f-713f-4f29-b51f-42efc5826a6e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1339 microversion: 2.20 time: 0.765408 Jul 18 14:19:38.528140 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 25/48] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:37 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1339 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:38.570771 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:38.576368 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:38.616427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:38.617350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:38.623521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:38.629095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.421636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:40.430866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0eb504b9-2553-41bd-83bb-badfe9b04ecc tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 1.889061 Jul 18 14:19:40.431446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 26/49] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:38 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:40.478503 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:40.480904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:40.510817 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.512084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.513501 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.514704 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.712503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:19:40.713006 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:19:40.713411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:19:40.713859 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:19:40.714293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:19:40.741423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.742957 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.745509 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:40.746839 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:40.872036 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:19:40.886714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for user 5ca8be8093b547ee953ea646f90fdcae and project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:19:40.936880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:19:40.951835 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:19:40.959092 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:40.978935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-39c5d1f8-5375-45f4-82ff-1b8b4704bddd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1293 microversion: 2.1 time: 0.533231 Jul 18 14:19:40.982358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 27/50] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:40 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1293 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:41.007673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:41.009938 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:41.036700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.039093 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.043267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.044732 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.273112 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:41.289561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c797e2c3-dd91-4f26-b31e-1e2989d7c5ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1292 microversion: 2.1 time: 0.303648 Jul 18 14:19:41.290478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 28/51] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:40 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1292 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:41.307701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c92d6f15-4853-4a62-9b09-d9affedf7da7 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a5db550>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:41.308855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8fee45dd-0108-4543-903f-22aa868ec07d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.528814 Jul 18 14:19:41.314345 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 24/52] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:19:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 5538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:19:41.341819 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:41.345367 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:41.369353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.370299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.375714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.376515 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.491619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c92d6f15-4853-4a62-9b09-d9affedf7da7 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/c3210ac1-5078-4b43-8c3f-76a3fd1ab09f" status: 200 len: 350 microversion: 2.1 time: 0.195844 Jul 18 14:19:41.494153 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 29/53] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:41 2022] GET /compute/v2.1/os-volumes/c3210ac1-5078-4b43-8c3f-76a3fd1ab09f => generated 350 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:41.714463 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-30247d84-312d-4427-b26d-9b35b7483d15 req-3084ee4a-5104-4fb3-89c1-6aaccab85de9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e", "tag": "df66f71e-315b-4540-a22d-369f45a277c8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:41.738459 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=10 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:41.745526 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-30247d84-312d-4427-b26d-9b35b7483d15 req-3084ee4a-5104-4fb3-89c1-6aaccab85de9 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.747009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-30247d84-312d-4427-b26d-9b35b7483d15 req-3084ee4a-5104-4fb3-89c1-6aaccab85de9 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.809446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-30247d84-312d-4427-b26d-9b35b7483d15 req-3084ee4a-5104-4fb3-89c1-6aaccab85de9 service nova] Creating event network-changed:df66f71e-315b-4540-a22d-369f45a277c8 for instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e on hv-cinder-79760 Jul 18 14:19:41.810260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-30247d84-312d-4427-b26d-9b35b7483d15 req-3084ee4a-5104-4fb3-89c1-6aaccab85de9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 14:19:41.814211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.815430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.816590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:41.821751 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:41.854719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.compute.rpcapi [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 14:19:41.857588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] Releasing lock "compute-rpcapi-router" {{(pid=117767) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 14:19:41.901147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-199b7702-cd5e-4dfa-a7de-0485298310bd None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.404340 Jul 18 14:19:41.902488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 30/54] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:41.914702 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-054b6f2c-3b6f-47ec-a368-9dc37194329b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:41.921862 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-054b6f2c-3b6f-47ec-a368-9dc37194329b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:42.980184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-054b6f2c-3b6f-47ec-a368-9dc37194329b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.003556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-054b6f2c-3b6f-47ec-a368-9dc37194329b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1236 microversion: 2.1 time: 1.095580 Jul 18 14:19:43.018509 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 31/55] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:41 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1236 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:43.026212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:43.027228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:43.038141 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:43.039343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:43.041265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:43.044111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:43.426462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.447300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3946c22c-e45f-4ca9-84c9-8be689a5309c tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.424841 Jul 18 14:19:43.452383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 32/56] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:43 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:43.478132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-08cded29-d5fc-4dd9-8434-73fd96f1c810 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a63e940>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:43.752086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-08cded29-d5fc-4dd9-8434-73fd96f1c810 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.295494 Jul 18 14:19:43.755514 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.758713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 33/57] 10.222.0.71 () {58 vars in 1133 bytes} [Mon Jul 18 14:19:43 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:43.776089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:43.777071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:43.787868 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:43.788804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:43.789141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.790977 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:43.792326 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:43.801229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:43.802640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d3d9da31-43aa-4da0-a9e0-86acb726e02c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 2.486839 Jul 18 14:19:43.803267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 25/58] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:41 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 2488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:43.825112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:43.828370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:43.836446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=11 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:43.850793 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:43.851614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:43.852657 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:43.853305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.188433 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:44.204214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:44.219331 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4647e372-b2c4-4b52-9765-e08ba2821d0b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1280 microversion: 2.1 time: 0.403830 Jul 18 14:19:44.219929 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 26/59] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:43 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1280 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:44.222983 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-737dddca-e893-448e-a2b4-419789c3323b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1299 microversion: 2.1 time: 0.462823 Jul 18 14:19:44.235954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 34/60] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:43 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1299 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:44.261162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7031e2bd-af64-403a-b42e-520dbb219b71 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a5fc5e0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:44.264521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:44.268297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:44.309567 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.326306 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.330132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.330758 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.586160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7031e2bd-af64-403a-b42e-520dbb219b71 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.364952 Jul 18 14:19:44.587347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 27/61] 10.222.0.71 () {58 vars in 1148 bytes} [Mon Jul 18 14:19:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:44.592094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-0b98c526-df47-4754-ae96-480f36f17bf4 req-e46a7d54-36f6-45ce-ac50-19c851c81755 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fedbc653-17b5-4127-8c87-b446551d81dc", "tag": "88e47ba7-e850-4769-8483-f5fc871ea2d9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:44.644694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:44.663994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0b98c526-df47-4754-ae96-480f36f17bf4 req-e46a7d54-36f6-45ce-ac50-19c851c81755 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.664238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-59e90d0a-2477-4e3a-ba83-3a6958132b1c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1288 microversion: 2.1 time: 0.427094 Jul 18 14:19:44.664839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 35/62] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:44 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1288 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:44.666075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0b98c526-df47-4754-ae96-480f36f17bf4 req-e46a7d54-36f6-45ce-ac50-19c851c81755 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.707019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:44.711374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:44.723842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-0b98c526-df47-4754-ae96-480f36f17bf4 req-e46a7d54-36f6-45ce-ac50-19c851c81755 service nova] Creating event network-changed:88e47ba7-e850-4769-8483-f5fc871ea2d9 for instance fedbc653-17b5-4127-8c87-b446551d81dc on hv-cinder-79760 Jul 18 14:19:44.725213 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0b98c526-df47-4754-ae96-480f36f17bf4 req-e46a7d54-36f6-45ce-ac50-19c851c81755 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 18 14:19:44.726595 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.728336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.729636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.730296 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.744254 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.744994 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.747908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:44.748555 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:44.767426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.compute.rpcapi [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 18 14:19:44.768745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] Releasing lock "compute-rpcapi-router" {{(pid=117766) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 18 14:19:44.811257 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1c48f6d7-ab04-4857-abea-92ba0317a653 None None] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222638 Jul 18 14:19:44.812275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 28/63] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:44.820109 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e6047317-ef6e-4c57-a231-8dc9471e82b2 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a5fc4c0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:45.128845 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e6047317-ef6e-4c57-a231-8dc9471e82b2 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.315279 Jul 18 14:19:45.129426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 29/64] 10.222.0.71 () {58 vars in 1133 bytes} [Mon Jul 18 14:19:44 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:45.134267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:45.135056 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:45.159306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:45.159477 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:45.160295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:45.160750 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:45.895191 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:45.908101 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c8baa973-329f-4a55-8fa0-c709e5587577 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 1.238815 Jul 18 14:19:45.909426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 36/65] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:44 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:45.917989 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6353a6b7-109b-4ef9-9f85-1fbc07836bc5 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a625670>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:46.150611 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6353a6b7-109b-4ef9-9f85-1fbc07836bc5 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.237174 Jul 18 14:19:46.154045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 37/66] 10.222.0.71 () {58 vars in 1166 bytes} [Mon Jul 18 14:19:45 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:46.160937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:46.162890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:46.216860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.217567 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.222027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.222482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.231325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.312688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.322210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.324966 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f05adfa9-033c-44b1-bd48-feee80b19526 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 1.194311 Jul 18 14:19:46.326250 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 30/67] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:45 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:46.339110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:46.340075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:46.357530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.365199 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.366505 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.367101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.619927 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.650508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5f5a70ea-ebac-4c62-928b-e0ae25abc1a2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1299 microversion: 2.1 time: 0.488263 Jul 18 14:19:46.651878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 38/68] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:46 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1299 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:46.659783 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:46.661839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:46.687366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.688210 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.689553 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:46.691307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:46.958721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:46.967082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7d3907a7-ccc0-4646-9df3-c3b88f00ec9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1294 microversion: 2.1 time: 0.313655 Jul 18 14:19:46.973250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 39/69] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:46 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1294 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:46.978052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9ca5513c-7571-4633-95c8-9c7566be1cc6 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a63eb80>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:47.052877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:47.066498 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-176d7b3e-ccaa-47b5-886b-0b69e3075aa2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.738566 Jul 18 14:19:47.071602 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 31/70] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:46 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:47.085996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:47.086617 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:47.101226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.101987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.104733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.105751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.206536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9ca5513c-7571-4633-95c8-9c7566be1cc6 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.232014 Jul 18 14:19:47.207087 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 40/71] 10.222.0.71 () {58 vars in 1169 bytes} [Mon Jul 18 14:19:46 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:47.219234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-df510ed0-bd96-4ee6-9398-db41950bf50c tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a625790>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:47.380993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-df510ed0-bd96-4ee6-9398-db41950bf50c tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.165438 Jul 18 14:19:47.382019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 41/72] 10.222.0.71 () {58 vars in 1154 bytes} [Mon Jul 18 14:19:47 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:47.654483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-808479ad-f47e-4071-880e-8082404be7d2 req-7ee34d36-e766-4c18-be94-df5067cf3d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:47.679915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-808479ad-f47e-4071-880e-8082404be7d2 req-7ee34d36-e766-4c18-be94-df5067cf3d69 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.680521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-808479ad-f47e-4071-880e-8082404be7d2 req-7ee34d36-e766-4c18-be94-df5067cf3d69 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.702862 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-808479ad-f47e-4071-880e-8082404be7d2 req-7ee34d36-e766-4c18-be94-df5067cf3d69 service nova] Creating event network-changed:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:19:47.712266 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-808479ad-f47e-4071-880e-8082404be7d2 req-7ee34d36-e766-4c18-be94-df5067cf3d69 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.325414 Jul 18 14:19:47.713773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 42/73] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:47.731515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:47.732221 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:47.739922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.740754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.741824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:47.742486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:47.787514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:48.217191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.229951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9a876115-d427-4156-9ba4-990ee14384ff tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 1.156974 Jul 18 14:19:48.231334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 32/74] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:47 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 1159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:48.242463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6e2d4349-ab9a-4c5a-aae0-7879d5c058c6 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a5fc4c0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:48.330596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.339087 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.340592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.341740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9155c04e-900b-4223-87ff-b16bfca34de9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.616803 Jul 18 14:19:48.349692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 43/75] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:47 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:48.361420 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:48.362232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:48.369061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.373879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.374476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.374924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.387097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6e2d4349-ab9a-4c5a-aae0-7879d5c058c6 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.154436 Jul 18 14:19:48.387708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 33/76] 10.222.0.71 () {58 vars in 1187 bytes} [Mon Jul 18 14:19:48 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:48.392365 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a71d9b0b-eda8-4420-b875-1f11f5dcb0ae req-de8dcf21-63e0-4fbb-8722-e2d12acfd43b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7677bd33-c598-4302-a355-13c48bca9e32", "tag": "ca3680d0-6384-4efa-85ac-32d714d865a4"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:48.405841 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a71d9b0b-eda8-4420-b875-1f11f5dcb0ae req-de8dcf21-63e0-4fbb-8722-e2d12acfd43b service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.406547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a71d9b0b-eda8-4420-b875-1f11f5dcb0ae req-de8dcf21-63e0-4fbb-8722-e2d12acfd43b service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.419943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a71d9b0b-eda8-4420-b875-1f11f5dcb0ae req-de8dcf21-63e0-4fbb-8722-e2d12acfd43b service nova] Creating event network-changed:ca3680d0-6384-4efa-85ac-32d714d865a4 for instance 7677bd33-c598-4302-a355-13c48bca9e32 on hv-cinder-79760 Jul 18 14:19:48.430797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a71d9b0b-eda8-4420-b875-1f11f5dcb0ae req-de8dcf21-63e0-4fbb-8722-e2d12acfd43b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041646 Jul 18 14:19:48.432158 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 34/77] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:48.441487 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:48.442736 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:48.450266 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.453399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.453399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.453399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.585103 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.593607 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d52c94af-bbba-45af-9528-909edd678368 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1294 microversion: 2.1 time: 0.159230 Jul 18 14:19:48.594869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 35/78] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:48 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1294 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:48.612345 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:48.613098 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:48.624799 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.625252 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.626215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:48.627076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:48.793814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.808785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-74cb3409-e7fe-45d9-8f20-8c2f0387f03f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.465135 Jul 18 14:19:48.810047 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 44/79] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:48 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:48.817958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4e9a94cf-4f23-4c48-a2de-68b4cec6b041 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] Calling method '.version_select at 0x7fb53a615ca0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:48.910117 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4e9a94cf-4f23-4c48-a2de-68b4cec6b041 tempest-VolumesTestJSON-36576212 tempest-VolumesTestJSON-36576212-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.098346 Jul 18 14:19:48.911373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 45/80] 10.222.0.71 () {58 vars in 1154 bytes} [Mon Jul 18 14:19:48 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:48.934266 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:48.945181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1c17407a-6485-4c3d-b58b-ac92d52de400 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.347966 Jul 18 14:19:48.955416 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 36/81] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:48 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:49.251913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:49.252822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:49.260871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:49.261325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:49.262194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:49.262640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:49.363297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:49.363953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:49.379938 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:49.380443 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:49.384578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:49.385772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:49.601193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:49.615841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-77b85e6a-9758-4719-8cbd-832ea0a3d5d6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.371371 Jul 18 14:19:49.617745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 46/82] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:49 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:19:49.626816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:49.627622 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:49.666194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:49.666671 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:49.667486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:49.667929 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.223990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.234741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.236361 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.238727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2d0bf3e9-3656-4957-80c3-25da0187c4d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.880428 Jul 18 14:19:50.239871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 37/83] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:49 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:50.246073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:50.247033 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:50.257315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.257939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.258768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.259305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.757012 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:50.772463 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-38c72547-92a7-4bb3-a1a5-1d18344e684c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 1.151636 Jul 18 14:19:50.773063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 47/84] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:49 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:50.778961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:50.779830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:50.796030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.796541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.797328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:50.798091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:50.922147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=30 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:51.021199 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.047041 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dc94ff14-0c87-4695-91cc-6cdd182f8876 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.805478 Jul 18 14:19:51.047661 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 38/85] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:50 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:51.062851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:51.067231 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:51.093341 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.093923 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.094746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.095655 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.151590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.170249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c86084f8-ba0b-4ae2-b43f-016770f58607 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.395344 Jul 18 14:19:51.187209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 48/86] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:50 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:51.259949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:51.261103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:51.321515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.322383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.326425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.329721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.802306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:51.814299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bca2d87a-8c30-4de2-8c00-92de6740ebcd tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.765198 Jul 18 14:19:51.815452 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 39/87] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:51 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:51.821076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:51.821830 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:51.852573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=8 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:51.856691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.857346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:51.858306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:51.859319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.372154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.396150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.398052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.399514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3ef07a9b-59ea-4e72-8dee-a41a542618a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 1.144309 Jul 18 14:19:52.413426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 49/88] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:51 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:52.419535 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:52.420147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:52.435809 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.436480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.442272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.444509 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.496212 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:52.525434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=89 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:52.533452 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a593d476-a0ef-45d8-9738-9ff303b3bf78 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.715749 Jul 18 14:19:52.536838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 40/89] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:51 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:52.545504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:52.547571 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:52.556962 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.557767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.559329 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:52.559950 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:52.988642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=28 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:53.136986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.146658 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-53b8962c-3b1b-4483-9d6a-76c97bde67f2 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.731233 Jul 18 14:19:53.148364 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 50/90] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:52 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:53.154939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-e82668b2-9115-4ddb-aeb7-17c759ff7196 req-d7d9a448-f872-44d0-af14-5f873d1d6894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da73439b-b34f-42fb-b28a-9fa41604ab3c", "tag": "869acbfc-dc56-4f1c-9dac-151d00c2f5e8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:53.167266 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e82668b2-9115-4ddb-aeb7-17c759ff7196 req-d7d9a448-f872-44d0-af14-5f873d1d6894 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.167947 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e82668b2-9115-4ddb-aeb7-17c759ff7196 req-d7d9a448-f872-44d0-af14-5f873d1d6894 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.181466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-e82668b2-9115-4ddb-aeb7-17c759ff7196 req-d7d9a448-f872-44d0-af14-5f873d1d6894 service nova] Creating event network-changed:869acbfc-dc56-4f1c-9dac-151d00c2f5e8 for instance da73439b-b34f-42fb-b28a-9fa41604ab3c on hv-cinder-79760 Jul 18 14:19:53.190997 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-e82668b2-9115-4ddb-aeb7-17c759ff7196 req-d7d9a448-f872-44d0-af14-5f873d1d6894 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041362 Jul 18 14:19:53.192505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 51/91] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:53.201021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:53.202161 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:53.210393 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.210845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.211829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.215663 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.380874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.396359 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-52f55e94-d3da-42f8-a11c-910dab5c5b17 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.857788 Jul 18 14:19:53.397274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 41/92] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:52 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:53.434135 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:53.435628 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:53.453780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.455504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.457517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.458503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.579974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.596080 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f5e2cdaf-3e27-4309-9493-d5ea319b9f74 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.401552 Jul 18 14:19:53.603568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 52/93] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:53 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:53.610895 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:53.613260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:53.622147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.623540 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.625351 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:53.626224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:53.797509 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.808334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.817597 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.820500 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e6435abc-a6c3-4368-b6de-eb5c15a086e0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.405512 Jul 18 14:19:53.829052 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 42/94] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:53 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:53.928827 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:53.936534 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7a924470-d25c-431e-b2af-394db8d279dd tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.331434 Jul 18 14:19:53.946008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 53/95] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:53 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:54.164235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:54.164827 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:54.171712 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.175910 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.176981 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.177896 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.416693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:54.416693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:54.421471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.427504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.428476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.428927 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.753780 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:54.764474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=8 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:54.767969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a7d000bc-ebac-4513-a1f1-8d54183e69b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.356873 Jul 18 14:19:54.771383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 54/96] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:54 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:54.776564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:54.784479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:54.794157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8fa1978b-4997-4ac4-b551-1921bb959799 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.633832 Jul 18 14:19:54.795671 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:54.806132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 43/97] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:54 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:54.813057 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.813900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.814989 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.815662 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.851477 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:54.852013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:54.862560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.863037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:54.863837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:54.864598 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.095590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:55.100488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:55.104766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0a41a91c-65e7-415a-b8c5-fc313fa5ed4d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.332016 Jul 18 14:19:55.105863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 55/98] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:54 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:55.116071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:55.117585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:55.122500 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6ee806ea-6342-464c-a9e7-3d4c5e80b3ae tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.276236 Jul 18 14:19:55.123086 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 44/99] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:54 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:55.129196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.130456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:55.138430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.138877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.139656 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.140083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.296306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:55.307522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-de9c57e0-6b3a-43e6-a964-f5dad4b73a29 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.182205 Jul 18 14:19:55.308442 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 45/100] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:55 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:55.313417 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-de7be37c-a64d-4aee-a3f3-4420d562832b req-e090ad7b-cb6f-4025-a3b7-52406fd2adea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3954bb52-b979-4fd0-84c0-c95c060085eb", "tag": "38d0ae5e-b6aa-4c94-b263-4e607bc0997c"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:55.325762 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-de7be37c-a64d-4aee-a3f3-4420d562832b req-e090ad7b-cb6f-4025-a3b7-52406fd2adea service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.326633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-de7be37c-a64d-4aee-a3f3-4420d562832b req-e090ad7b-cb6f-4025-a3b7-52406fd2adea service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.335204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-41a81172-bccc-4819-aee5-52c534701c71 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Action: 'create', calling method: .version_select at 0x7fb53a615ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1769203310", "metadata": {"Type": "work"}}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:55.341232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-de7be37c-a64d-4aee-a3f3-4420d562832b req-e090ad7b-cb6f-4025-a3b7-52406fd2adea service nova] Creating event network-changed:38d0ae5e-b6aa-4c94-b263-4e607bc0997c for instance 3954bb52-b979-4fd0-84c0-c95c060085eb on hv-cinder-79760 Jul 18 14:19:55.347913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-de7be37c-a64d-4aee-a3f3-4420d562832b req-e090ad7b-cb6f-4025-a3b7-52406fd2adea service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038006 Jul 18 14:19:55.348843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 46/101] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-41a81172-bccc-4819-aee5-52c534701c71 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Request method failure captured: Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 122 Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WwKv-Or_UOI5ifJ2KTehIBI9Y5RxOuPK_HXWpg4Pq0O94kvVsGl_YdaEYpC6opk1YG43UXdcmb6jplFMiae9pld_iXFySjpeuTh71AZ1DmVBE9aJAxKbCqpghE3VGDArTwxEv5Amo0jbrQL1HSmYKKz6pXA_UIPMeHN7yeMU4FI_mc Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:19:55.357592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_87a7c5decdc24b95898519bbf60d77ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 7f20a0f9e2d94e1987621b56211519bf Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1769203310", "metadata": {"Type": "work"}}} Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: Jul 18 14:19:55.358949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1769203310', 'metadata': {'Type': 'work'}}}} Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi '#$%' Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:55.359676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:19:55.361620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:19:55.364742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 18 14:19:55.364742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.364742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-41a81172-bccc-4819-aee5-52c534701c71 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:55.364742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-41a81172-bccc-4819-aee5-52c534701c71 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.252206 Jul 18 14:19:55.364742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 56/102] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 18 14:19:55 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 253 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:19:55.373053 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dfe63d4f-772f-44c3-a197-c562d865c27d tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Action: 'create', calling method: .version_select at 0x7fb53a623b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1727526499", "metadata": {"Type": "work"}}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dfe63d4f-772f-44c3-a197-c562d865c27d tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Request method failure captured: Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 120 Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WwKv-Or_UOI5ifJ2KTehIBI9Y5RxOuPK_HXWpg4Pq0O94kvVsGl_YdaEYpC6opk1YG43UXdcmb6jplFMiae9pld_iXFySjpeuTh71AZ1DmVBE9aJAxKbCqpghE3VGDArTwxEv5Amo0jbrQL1HSmYKKz6pXA_UIPMeHN7yeMU4FI_mc Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:19:55.376871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_87a7c5decdc24b95898519bbf60d77ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 7f20a0f9e2d94e1987621b56211519bf Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1727526499", "metadata": {"Type": "work"}}} Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: Jul 18 14:19:55.378229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1727526499', 'metadata': {'Type': 'work'}}}} Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi '0' Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:55.378904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:19:55.382475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:19:55.384955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 18 14:19:55.384955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.384955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dfe63d4f-772f-44c3-a197-c562d865c27d tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:55.384955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dfe63d4f-772f-44c3-a197-c562d865c27d tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011484 Jul 18 14:19:55.384955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 47/103] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 18 14:19:55 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:19:55.391989 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6d832c6b-7e11-42cb-8700-c55c678a3d82 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Action: 'create', calling method: .version_select at 0x7fb53a5db9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-387419980", "metadata": {"Type": "work"}}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6d832c6b-7e11-42cb-8700-c55c678a3d82 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Request method failure captured: Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 118 Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WwKv-Or_UOI5ifJ2KTehIBI9Y5RxOuPK_HXWpg4Pq0O94kvVsGl_YdaEYpC6opk1YG43UXdcmb6jplFMiae9pld_iXFySjpeuTh71AZ1DmVBE9aJAxKbCqpghE3VGDArTwxEv5Amo0jbrQL1HSmYKKz6pXA_UIPMeHN7yeMU4FI_mc Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:19:55.394893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_87a7c5decdc24b95898519bbf60d77ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 7f20a0f9e2d94e1987621b56211519bf Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-387419980", "metadata": {"Type": "work"}}} Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: Jul 18 14:19:55.397608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-387419980', 'metadata': {'Type': 'work'}}}} Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise error Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi '' Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:55.399873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 18 14:19:55.403218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 18 14:19:55.405495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 18 14:19:55.405495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.405495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6d832c6b-7e11-42cb-8700-c55c678a3d82 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:55.405495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6d832c6b-7e11-42cb-8700-c55c678a3d82 tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011241 Jul 18 14:19:55.405495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 57/104] 10.222.0.71 () {60 vars in 1155 bytes} [Mon Jul 18 14:19:55 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 14:19:55.409218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f336043a-34fc-414c-b2fb-370e63de286a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Calling method '.version_select at 0x7fb53a5a23a0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.460258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-f336043a-34fc-414c-b2fb-370e63de286a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] HTTP exception thrown: Volume tempest-invalid-166993351 could not be found. Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f336043a-34fc-414c-b2fb-370e63de286a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Request method failure captured: Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-166993351 HTTP/1.1 Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WwKv-Or_UOI5ifJ2KTehIBI9Y5RxOuPK_HXWpg4Pq0O94kvVsGl_YdaEYpC6opk1YG43UXdcmb6jplFMiae9pld_iXFySjpeuTh71AZ1DmVBE9aJAxKbCqpghE3VGDArTwxEv5Amo0jbrQL1HSmYKKz6pXA_UIPMeHN7yeMU4FI_mc Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:19:55.462271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_87a7c5decdc24b95898519bbf60d77ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 7f20a0f9e2d94e1987621b56211519bf Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Volume tempest-invalid-166993351 could not be found. Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'tempest-invalid-166993351'} Jul 18 14:19:55.463479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-166993351 could not be found. (HTTP 404) (Request-ID: req-ffe47c4b-bcec-4b7d-bf71-2e48d09ebb8c) Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.464166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:19:55.465506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-166993351 could not be found. Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:55.467167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-166993351 could not be found. Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-166993351 could not be found. Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f336043a-34fc-414c-b2fb-370e63de286a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Returning 404 to user: Volume tempest-invalid-166993351 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f336043a-34fc-414c-b2fb-370e63de286a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/tempest-invalid-166993351" status: 404 len: 98 microversion: 2.1 time: 0.059693 Jul 18 14:19:55.469913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 48/105] 10.222.0.71 () {58 vars in 1214 bytes} [Mon Jul 18 14:19:55 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-166993351 => generated 98 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 18 14:19:55.478765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3b9fc95d-f57a-4a5d-9a75-383a7e8ad0cd tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003995 Jul 18 14:19:55.483560 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 58/106] 10.222.0.71 () {58 vars in 1139 bytes} [Mon Jul 18 14:19:55 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 14:19:55.489490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0f90fc35-6fe7-4098-ad2c-98f828dcae7c tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004155 Jul 18 14:19:55.494558 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 49/107] 10.222.0.71 () {58 vars in 1136 bytes} [Mon Jul 18 14:19:55 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 18 14:19:55.500253 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-93fec861-8bed-4e6a-97c2-bb8075da51ef tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Calling method '.version_select at 0x7fb53a683550>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.541452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-93fec861-8bed-4e6a-97c2-bb8075da51ef tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] HTTP exception thrown: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-93fec861-8bed-4e6a-97c2-bb8075da51ef tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Request method failure captured: Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/os-volumes/0af85b64-5047-4b06-ac00-bc177e0a2e08 HTTP/1.1 Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WwKv-Or_UOI5ifJ2KTehIBI9Y5RxOuPK_HXWpg4Pq0O94kvVsGl_YdaEYpC6opk1YG43UXdcmb6jplFMiae9pld_iXFySjpeuTh71AZ1DmVBE9aJAxKbCqpghE3VGDArTwxEv5Amo0jbrQL1HSmYKKz6pXA_UIPMeHN7yeMU4FI_mc Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:19:55.543992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_87a7c5decdc24b95898519bbf60d77ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 7f20a0f9e2d94e1987621b56211519bf Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '0af85b64-5047-4b06-ac00-bc177e0a2e08'} Jul 18 14:19:55.545215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. (HTTP 404) (Request-ID: req-d10dea9e-6557-4711-8967-f49ebe1b6e04) Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.545984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 18 14:19:55.551941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 18 14:19:55.553053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-93fec861-8bed-4e6a-97c2-bb8075da51ef tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Returning 404 to user: Volume 0af85b64-5047-4b06-ac00-bc177e0a2e08 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-93fec861-8bed-4e6a-97c2-bb8075da51ef tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "DELETE /compute/v2.1/os-volumes/0af85b64-5047-4b06-ac00-bc177e0a2e08" status: 404 len: 109 microversion: 2.1 time: 0.049988 Jul 18 14:19:55.554077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 59/108] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:19:55 2022] DELETE /compute/v2.1/os-volumes/0af85b64-5047-4b06-ac00-bc177e0a2e08 => generated 109 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:19:55.563223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eadabb0a-c6e5-4f34-8987-4e02200e243a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Calling method '.version_select at 0x7fb53a623af0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.612070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-eadabb0a-c6e5-4f34-8987-4e02200e243a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] HTTP exception thrown: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eadabb0a-c6e5-4f34-8987-4e02200e243a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Request method failure captured: Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/os-volumes/eb0b3427-61d8-4116-83bc-984083193bc3 HTTP/1.1 Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WwKv-Or_UOI5ifJ2KTehIBI9Y5RxOuPK_HXWpg4Pq0O94kvVsGl_YdaEYpC6opk1YG43UXdcmb6jplFMiae9pld_iXFySjpeuTh71AZ1DmVBE9aJAxKbCqpghE3VGDArTwxEv5Amo0jbrQL1HSmYKKz6pXA_UIPMeHN7yeMU4FI_mc Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:19:55.614874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/87a7c5decdc24b95898519bbf60d77ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_87a7c5decdc24b95898519bbf60d77ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 87a7c5decdc24b95898519bbf60d77ac Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-171059861 Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 7f20a0f9e2d94e1987621b56211519bf Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-171059861-project Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'eb0b3427-61d8-4116-83bc-984083193bc3'} Jul 18 14:19:55.616150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. (HTTP 404) (Request-ID: req-4d9ab4bb-abf8-4c5e-993e-a8e6a7cd757f) Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.616904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 18 14:19:55.618405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 18 14:19:55.622028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eadabb0a-c6e5-4f34-8987-4e02200e243a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] Returning 404 to user: Volume eb0b3427-61d8-4116-83bc-984083193bc3 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:19:55.624083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eadabb0a-c6e5-4f34-8987-4e02200e243a tempest-VolumesNegativeTest-171059861 tempest-VolumesNegativeTest-171059861-project] 10.222.0.71 "GET /compute/v2.1/os-volumes/eb0b3427-61d8-4116-83bc-984083193bc3" status: 404 len: 109 microversion: 2.1 time: 0.059476 Jul 18 14:19:55.634843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 50/109] 10.222.0.71 () {58 vars in 1244 bytes} [Mon Jul 18 14:19:55 2022] GET /compute/v2.1/os-volumes/eb0b3427-61d8-4116-83bc-984083193bc3 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:19:55.792554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.793366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:55.809051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.809821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.817090 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.817734 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.822079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:55.822926 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:55.832953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.835962 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:55.837124 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:55.837640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.051587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.070477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-faef6c19-d0c3-4c51-a16f-bd8dbe8b4e26 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.281889 Jul 18 14:19:56.071071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 60/110] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:55 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:56.122378 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:56.123323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:56.135908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.136636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.137598 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.138235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.218193 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.229974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cd31f546-fb23-4af6-a3c2-6f911dd1470a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.412642 Jul 18 14:19:56.241961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 51/111] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:55 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:56.247837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:56.248687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:56.256351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.257086 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.258224 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.258918 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.469228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.477814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3588c03c-a4b4-4597-8145-d83620cc5879 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.359165 Jul 18 14:19:56.478383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 61/112] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:56 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:56.556244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-f353cc88-8e80-405b-a302-bedca9a9a4d5 req-a0a74348-5658-4936-ac00-bf5dc5563f40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e", "name": "network-vif-plugged", "status": "completed", "tag": "df66f71e-315b-4540-a22d-369f45a277c8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:56.565529 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-f353cc88-8e80-405b-a302-bedca9a9a4d5 req-a0a74348-5658-4936-ac00-bf5dc5563f40 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.566038 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-f353cc88-8e80-405b-a302-bedca9a9a4d5 req-a0a74348-5658-4936-ac00-bf5dc5563f40 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.585486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-f353cc88-8e80-405b-a302-bedca9a9a4d5 req-a0a74348-5658-4936-ac00-bf5dc5563f40 service nova] Creating event network-vif-plugged:df66f71e-315b-4540-a22d-369f45a277c8 for instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e on hv-cinder-79760 Jul 18 14:19:56.591940 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-f353cc88-8e80-405b-a302-bedca9a9a4d5 req-a0a74348-5658-4936-ac00-bf5dc5563f40 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111202 Jul 18 14:19:56.592311 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.592596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 62/113] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:19:56.599652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:56.600842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:56.604444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.606696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.608139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-97ba2c26-5315-44bc-afa2-e0b8270e73d3 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.364676 Jul 18 14:19:56.608823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 52/114] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:56 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:56.610239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.611102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.612961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:56.613474 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:56.875161 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:56.914375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9cf84212-c768-4cda-874c-1868a8e797da tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.320149 Jul 18 14:19:56.915605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 63/115] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:56 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:57.088125 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.088984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.095696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.096320 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.097218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.098039 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.248336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.254037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.257432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.264625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0d22c2c3-27ca-490c-a0da-b33ea6fc6f54 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.180642 Jul 18 14:19:57.264845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.265155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.266294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.266950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.277303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 53/116] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:57.424755 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.433232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-800a3bcb-9c72-4ed4-81b8-9379f85e6085 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.189082 Jul 18 14:19:57.434150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 64/117] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:19:57.497082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.497623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.504780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.505293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.506220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.506684 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.630018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.630713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.639119 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.639457 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.641080 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.642992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.698781 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.711635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-24a3c077-2296-440d-9b30-e819fbe5c89d tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.218762 Jul 18 14:19:57.714261 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 54/118] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:57.842404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.851752 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.853244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:57.855130 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fd15e0b0-4e0a-4b12-991b-56c8a2d46fe2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.231885 Jul 18 14:19:57.855689 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 65/119] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:19:57.932392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:57.933022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:57.939258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.939780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:57.941285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:57.941747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.115425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.125454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8efe69de-c523-4c38-9a72-f99bfcc9ba00 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.196887 Jul 18 14:19:58.126261 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 55/120] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:57 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:58.288105 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:58.289044 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:58.299124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.300515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.301955 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.302917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.323023 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:19:58.451351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:58.452310 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:58.462877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.463333 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.464150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.464716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.465489 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.480027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6485b1ea-8bb2-4fe8-8d69-8a597508b0d7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.198834 Jul 18 14:19:58.480978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 66/121] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:58 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:58.619600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.627967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d1342fdb-85f2-4333-9308-5b74842f90e0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.180267 Jul 18 14:19:58.633471 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 56/122] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:58 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:19:58.640924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-1dac472c-e9c9-4cd6-af3e-6366ca796982 req-fea2b868-1e10-48cc-affc-4c5cd6fde745 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedbc653-17b5-4127-8c87-b446551d81dc", "name": "network-vif-plugged", "status": "completed", "tag": "88e47ba7-e850-4769-8483-f5fc871ea2d9"}, {"server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "name": "network-vif-plugged", "status": "completed", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:19:58.651631 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-1dac472c-e9c9-4cd6-af3e-6366ca796982 req-fea2b868-1e10-48cc-affc-4c5cd6fde745 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.652113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-1dac472c-e9c9-4cd6-af3e-6366ca796982 req-fea2b868-1e10-48cc-affc-4c5cd6fde745 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.666638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-1dac472c-e9c9-4cd6-af3e-6366ca796982 req-fea2b868-1e10-48cc-affc-4c5cd6fde745 service nova] Creating event network-vif-plugged:88e47ba7-e850-4769-8483-f5fc871ea2d9 for instance fedbc653-17b5-4127-8c87-b446551d81dc on hv-cinder-79760 Jul 18 14:19:58.667147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-1dac472c-e9c9-4cd6-af3e-6366ca796982 req-fea2b868-1e10-48cc-affc-4c5cd6fde745 service nova] Creating event network-vif-plugged:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:19:58.673969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-1dac472c-e9c9-4cd6-af3e-6366ca796982 req-fea2b868-1e10-48cc-affc-4c5cd6fde745 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038976 Jul 18 14:19:58.674900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 67/123] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:19:58.731226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:58.731842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:58.739969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.740422 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.741201 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.741635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.875169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:58.876020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:58.884403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.884849 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.885824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:58.886294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:58.897873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:58.907448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1887b929-b574-47ce-ac4f-c05a2b0a4df3 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.180192 Jul 18 14:19:58.908732 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 57/124] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:58 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:59.065428 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.077773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.079720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.082185 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dd4f8386-6e3a-42ef-af44-cc2eeae294dc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.212880 Jul 18 14:19:59.092220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 68/125] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:19:58 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:19:59.144192 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:59.144810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:59.151626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.152101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.153172 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.153783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.309753 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.318483 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eaeaade4-ab0f-43d7-9e65-ef9fd51b0d66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.179036 Jul 18 14:19:59.319374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 58/126] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:59 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:59.498479 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:59.499094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:59.506005 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.506510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.507234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.507849 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.645260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:59.646162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:59.654013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.654571 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.655724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.656173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.695803 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.719282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-628821e0-ffef-4c98-9e91-6aebaa105226 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.224513 Jul 18 14:19:59.719826 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 69/127] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:59 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:59.824099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:19:59.831979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d06f3930-0ac0-4ccf-92f5-f648108c15f5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.191225 Jul 18 14:19:59.832657 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 59/128] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:59 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:19:59.928210 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:19:59.928829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:19:59.935449 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.936200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:19:59.936980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:19:59.937412 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.100368 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.106550 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:00.109148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5bb5782d-6541-499e-ac1f-1b824ecedcb6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.186769 Jul 18 14:20:00.109755 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 70/129] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:19:59 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:00.119152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:00.128315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.128788 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.129594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.130067 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.298695 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.309959 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.312377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.314097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-524a7174-ae8c-4134-875f-cf0578994646 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.214941 Jul 18 14:20:00.324728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 60/130] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:00 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:00.338783 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:00.339400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:00.346847 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.347129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.347949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.348384 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.524433 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.533178 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ad5b63f3-5814-4e66-9178-f8da15e69b9e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.199212 Jul 18 14:20:00.534021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 71/131] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:00 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:00.738106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:00.738361 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:00.744975 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.745428 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.746244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.746675 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.850950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:00.851816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:00.858664 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.859124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.859948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:00.860589 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:00.902020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:00.911319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8880d5ba-b12e-47f7-9f01-e1ff4bbfc1f0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.177441 Jul 18 14:20:00.912101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 61/132] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:00 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:00.998169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.010109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-27c52cec-c48f-4ddf-af1d-786f28c1e1b9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.160764 Jul 18 14:20:01.010109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 72/133] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:00 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:01.128178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.128780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.135453 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.135977 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.136871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.137305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.140235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:01.282522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.290295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9491399f-f929-4566-ae82-17bfcaddcffa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.167440 Jul 18 14:20:01.290888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 62/134] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:01 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:01.333294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.333914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.340203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.340652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.341421 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.341892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.497723 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.506994 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.508821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.510093 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ae0feac2-85d1-40a4-a746-9d58bbd4e87c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.181494 Jul 18 14:20:01.510720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 73/135] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:01 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:01.550679 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.551323 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.557688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.558157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.558953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.559559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.711773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:01.719172 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-30cce2f3-f06d-4cd8-b9ff-befdfb477f5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.172398 Jul 18 14:20:01.719735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 63/136] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:01 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:01.929894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:01.930607 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:01.937234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.937775 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:01.938599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:01.939089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.024207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.025147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.031896 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.032363 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.033371 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.033719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.094060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:02.102980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-506fbcb5-7f7d-4e3e-b3ff-414aad992e4b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.177090 Jul 18 14:20:02.103733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 74/137] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:01 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:02.184251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:02.194025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ba92d634-8058-4563-87c0-e498d332edb6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.173678 Jul 18 14:20:02.194894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 64/138] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:02.310345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.310981 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.317879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.318522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.319333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.319780 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.529904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.530535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.541314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.544237 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.545351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.547843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.945396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:02.955617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b64f7d72-6803-48f8-97c7-125289b6775f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.650148 Jul 18 14:20:02.956240 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 75/139] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:02.962229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:02.963118 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:02.971213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.971845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:02.972902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:02.973601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.122672 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.131895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.133349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.134484 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-168f507a-4dee-44f9-90b1-9cef8f1f7d1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.609843 Jul 18 14:20:03.135042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 65/140] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:03.150869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:03.151717 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:03.158008 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.159069 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.159825 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.160430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.421522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.430951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c770e5c8-32d1-4d6d-a589-004e703447dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.473832 Jul 18 14:20:03.431554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 76/141] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:02 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:03.439816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:03.440738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:03.450470 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.450931 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.451775 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.452218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.849158 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.860166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33a1e147-66e4-4e55-bbff-ce2bef2bd82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.712888 Jul 18 14:20:03.875821 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 66/142] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:03 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:03.959944 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:03.974882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:03.976125 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:03.981293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-93559116-8584-4347-a9c3-398b916bb41d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.548458 Jul 18 14:20:03.983599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 77/143] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:03 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:03.989328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.991290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.993446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:03.995572 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:03.999836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-278220d6-604d-4f2b-b094-3a04532c986a req-739b02ca-7c36-4065-90f2-85b2e57cc299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7677bd33-c598-4302-a355-13c48bca9e32", "name": "network-vif-plugged", "status": "completed", "tag": "ca3680d0-6384-4efa-85ac-32d714d865a4"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:04.023391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-278220d6-604d-4f2b-b094-3a04532c986a req-739b02ca-7c36-4065-90f2-85b2e57cc299 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.025300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-278220d6-604d-4f2b-b094-3a04532c986a req-739b02ca-7c36-4065-90f2-85b2e57cc299 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.052797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-278220d6-604d-4f2b-b094-3a04532c986a req-739b02ca-7c36-4065-90f2-85b2e57cc299 service nova] Creating event network-vif-plugged:ca3680d0-6384-4efa-85ac-32d714d865a4 for instance 7677bd33-c598-4302-a355-13c48bca9e32 on hv-cinder-79760 Jul 18 14:20:04.063179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-278220d6-604d-4f2b-b094-3a04532c986a req-739b02ca-7c36-4065-90f2-85b2e57cc299 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074534 Jul 18 14:20:04.064770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 78/144] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:04.157165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:04.158224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:04.171926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.177986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.178982 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.179477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.267519 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.280745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1c004279-f230-47f5-b703-a18d11f0cea9 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.311376 Jul 18 14:20:04.293927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 67/145] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:03 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:04.400275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.410603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.412615 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.414130 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-30d9788a-82f1-4fb5-9f27-179524268236 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.264675 Jul 18 14:20:04.415155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 79/146] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:04 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:04.449985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:04.450992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:04.464071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.465279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.466690 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.467306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.712729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:04.723312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d06d6389-07f4-4a01-8da6-cbcaf7fe93b9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.277644 Jul 18 14:20:04.729883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 68/147] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:04 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:04.878601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:04.879349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:04.885934 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.886408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:04.887191 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:04.887613 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.000533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:05.001150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:05.007424 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.007785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.008559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.009275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.032922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.041200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5838783f-abea-4387-b0db-3e85e9473d25 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.167314 Jul 18 14:20:05.041797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 80/148] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:04 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:05.153732 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.163265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ad29f3a0-79fb-4e08-ac4f-dacd4876b582 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.166439 Jul 18 14:20:05.163862 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 69/149] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:04 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:05.300212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:05.300407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:05.307381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.307833 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.308667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.309026 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.433867 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:05.434562 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:05.440532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.440976 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.441985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.442398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.463430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.472504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-956408eb-b28c-48a5-9248-3630a64d024a tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.176523 Jul 18 14:20:05.473427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 81/150] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:05 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:05.615311 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.623448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.624953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.626110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-65561c44-685a-44fc-9033-c606c3478e81 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.197423 Jul 18 14:20:05.626952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 70/151] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:05 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:05.743564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:05.745373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:05.756218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.756681 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.757649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:05.759357 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:05.942859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:05.950665 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e22bd11-c7fe-44f2-8517-4c44b9a9d2d3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.213121 Jul 18 14:20:05.951282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 82/152] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:05 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:06.058204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.059820 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.066956 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.067623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.068179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.068614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.098022 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-98c0eb75-531d-4a12-aedf-e822830bf6e5 req-22d24169-4291-41f7-b405-ee71ab689929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3954bb52-b979-4fd0-84c0-c95c060085eb", "name": "network-vif-plugged", "status": "completed", "tag": "38d0ae5e-b6aa-4c94-b263-4e607bc0997c"}, {"server_uuid": "da73439b-b34f-42fb-b28a-9fa41604ab3c", "name": "network-vif-plugged", "status": "completed", "tag": "869acbfc-dc56-4f1c-9dac-151d00c2f5e8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:06.114203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-98c0eb75-531d-4a12-aedf-e822830bf6e5 req-22d24169-4291-41f7-b405-ee71ab689929 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.114684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-98c0eb75-531d-4a12-aedf-e822830bf6e5 req-22d24169-4291-41f7-b405-ee71ab689929 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.129031 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-98c0eb75-531d-4a12-aedf-e822830bf6e5 req-22d24169-4291-41f7-b405-ee71ab689929 service nova] Creating event network-vif-plugged:38d0ae5e-b6aa-4c94-b263-4e607bc0997c for instance 3954bb52-b979-4fd0-84c0-c95c060085eb on hv-cinder-79760 Jul 18 14:20:06.129852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-98c0eb75-531d-4a12-aedf-e822830bf6e5 req-22d24169-4291-41f7-b405-ee71ab689929 service nova] Creating event network-vif-plugged:869acbfc-dc56-4f1c-9dac-151d00c2f5e8 for instance da73439b-b34f-42fb-b28a-9fa41604ab3c on hv-cinder-79760 Jul 18 14:20:06.136768 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-98c0eb75-531d-4a12-aedf-e822830bf6e5 req-22d24169-4291-41f7-b405-ee71ab689929 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.042518 Jul 18 14:20:06.137375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 83/153] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:06 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:06.183891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.184837 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.192950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.193401 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.194385 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.195766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.298854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.309461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a9087c53-fc3d-41af-8629-03c4d8b86c45 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.255056 Jul 18 14:20:06.310234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 71/154] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:06.493689 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.496867 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.507608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.508373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.509794 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.510505 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.534148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.555151 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e997700a-1c3f-41c7-a86c-3a869274c903 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.377685 Jul 18 14:20:06.557047 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 84/155] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:06.650804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.653107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.665696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.667053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.668359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.669200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.675274 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:06.804797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.818744 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4a6d2120-8cfb-4350-8e57-4af314863897 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1315 microversion: 2.1 time: 0.332502 Jul 18 14:20:06.831185 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 72/156] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1315 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:06.890897 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.905280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.907224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:06.909030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c1bc9a84-be8d-4370-aaa6-85b189da6e90 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1407 microversion: 2.20 time: 0.267177 Jul 18 14:20:06.909848 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 85/157] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:20:06.968708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:06.969328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:06.977230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.977714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:06.978629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:06.979025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.165852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:07.173365 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-308a2566-d6b6-4a71-9e3f-da56106bd0cf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.209542 Jul 18 14:20:07.173975 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 73/158] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:06 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:07.337738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:07.338287 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:07.344524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.344981 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.345786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.346303 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.543852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:07.555073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d06ebcf4-c6eb-46d6-8f2e-bcb40dffe89e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.221208 Jul 18 14:20:07.556220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 86/159] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:07 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:07.574546 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:07.575116 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:07.582160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.582603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.583978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.584415 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.751447 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:07.765489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9ba193b2-19ec-4137-b49d-f14ab51c8abd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.193786 Jul 18 14:20:07.766157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 74/160] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:07 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:07.837632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:07.838246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:07.845313 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.846120 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.847025 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.847465 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.935642 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:07.936403 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:07.946927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.947702 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:07.948489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:07.948924 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.057050 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.071870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2a18ab09-5ecd-41ad-8dff-2b2f372745ec tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1502 microversion: 2.1 time: 0.237992 Jul 18 14:20:08.072790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 87/161] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:07 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1502 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:08.143574 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.153162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.154749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.155948 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b58822d1-4b9d-43d3-804d-476fb756be2c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1599 microversion: 2.20 time: 0.227888 Jul 18 14:20:08.156510 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 75/162] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:20:07 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1599 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:20:08.185765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:08.186742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:08.192080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:08.192861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:08.199829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:08.202871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.204105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.204631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.204740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.205550 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.205741 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.206058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.206177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.511115 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-044a66dc-a42e-406c-a697-45ed4dad19f5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.337322 Jul 18 14:20:08.511797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 88/163] 10.222.0.71 () {60 vars in 1315 bytes} [Mon Jul 18 14:20:08 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-interface => generated 284 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:20:08.536535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.554499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d8b69032-3046-4696-bd09-3deb78d1fab9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.364687 Jul 18 14:20:08.555551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 76/164] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:08 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:08.573233 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:08.573884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:08.588840 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.589608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.590993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.591854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.786851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:08.787456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:08.797007 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.797780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.798764 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:08.799917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:08.801900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:08.809970 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-01ff0656-b0d2-4d28-a15d-946ec86c8792 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.241023 Jul 18 14:20:08.820350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 89/165] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:08 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:09.081549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:09.099414 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5467eff1-2461-4a14-aaba-f6a4f2d36594 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.317810 Jul 18 14:20:09.100329 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 77/166] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:08 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:09.577037 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:09.577037 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:09.581435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.582260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.583155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.583859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.741521 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b4bbccf8-efbb-4e8f-b0dc-a07a45a39e20"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:09.744804 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:09.758598 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.760173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.761208 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.764434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.886046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:09.895476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2efc0435-cd2c-4144-ad97-ea407e7d4820 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.326515 Jul 18 14:20:09.900763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 90/167] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:09 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:09.908061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:09.908875 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:09.927156 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.929585 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:09.930783 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:09.932110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:09.934062 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.187899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:10.196854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3297aab2-b6dc-4790-8fdc-fc04ec54cfa7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.294636 Jul 18 14:20:10.206517 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 91/168] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:09 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:10.211993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:10.212942 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:10.222104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.222726 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.223740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.224159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.397682 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:10.412017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b48a2ecb-8c78-4ce5-b986-dde013435c98 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.201424 Jul 18 14:20:10.412017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 92/169] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:10 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:10.432619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-7a70c79f-5bef-4048-83ae-f9dfd6d9a435 req-cf211ffe-a043-49c9-91c0-b656bfc0d768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:10.443608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-7a70c79f-5bef-4048-83ae-f9dfd6d9a435 req-cf211ffe-a043-49c9-91c0-b656bfc0d768 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.444050 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-7a70c79f-5bef-4048-83ae-f9dfd6d9a435 req-cf211ffe-a043-49c9-91c0-b656bfc0d768 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.456782 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-7a70c79f-5bef-4048-83ae-f9dfd6d9a435 req-cf211ffe-a043-49c9-91c0-b656bfc0d768 service nova] Creating event network-changed:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:20:10.463231 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-7a70c79f-5bef-4048-83ae-f9dfd6d9a435 req-cf211ffe-a043-49c9-91c0-b656bfc0d768 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034277 Jul 18 14:20:10.464185 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 93/170] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:10.919659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:10.920650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:10.928306 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.928758 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:10.929544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:10.930086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.188178 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:11.199202 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1d971efb-64a6-4fc5-b0a0-26077ad4228d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.283535 Jul 18 14:20:11.213784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 94/171] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:10 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:11.223314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:11.224868 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:11.233957 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.234718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.235747 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.236379 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.519527 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:11.535506 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cd7da7b5-84cd-4dea-887a-fb2064ce9b87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.319207 Jul 18 14:20:11.536692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 95/172] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:11 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:11.546302 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:11.547563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:11.560649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.561436 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.568685 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:11.570106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:11.772593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:11.784939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f09473ab-2f5a-4413-b510-853eb4bce38b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.246690 Jul 18 14:20:11.785644 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 96/173] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:11 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:12.220213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.220864 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.227701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.228234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.228932 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.229365 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.378251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:12.385873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-68a9883b-e822-432c-8bd3-6f8b4a76f413 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.169425 Jul 18 14:20:12.386426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 97/174] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:12 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:12.562195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.562987 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.571506 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.571896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.573014 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.573673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.806592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:12.816002 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-28da69a1-7be5-4638-9f86-9b25245fb2b8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1322 microversion: 2.1 time: 0.257794 Jul 18 14:20:12.827450 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 98/175] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:12 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:12.832835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:12.833441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:12.840842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.841431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.842359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:12.842883 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:12.989704 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:12.998069 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-010042fe-d933-4264-afe4-cec2bf92b0d7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.169330 Jul 18 14:20:12.998675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 99/176] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:12 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:13.404787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:13.406186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:13.417061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:13.419064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:13.419954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:13.420561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:13.585283 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:13.593441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d7315773-4248-4438-81c8-14ad542c43ef tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1361 microversion: 2.1 time: 0.193964 Jul 18 14:20:13.594942 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 100/177] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:13 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:13.813552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-961572037", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "networks": [{"uuid": "72c5cb8a-49de-4a64-927c-6cce6f71eb64"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:13.874396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] validate_networks() for [('72c5cb8a-49de-4a64-927c-6cce6f71eb64', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:20:14.268497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:20:14.269155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:20:14.269542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:20:14.269975 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:20:14.270402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:20:14.280018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.280460 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.281242 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.282293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.301575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Getting quotas for project 2bba9fd8306e43b6b1cbc2dd4a789736. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:20:14.306175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Getting quotas for user 2865db5146784ee188001703d85d8809 and project 2bba9fd8306e43b6b1cbc2dd4a789736. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:20:14.317199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:20:14.319504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:20:14.369243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3b63570-497c-43b1-93aa-2d6e864b7777 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560013 Jul 18 14:20:14.369866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 101/178] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:20:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:20:14.374430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:14.375027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:14.381804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.382247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.383003 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.383475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.530440 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.538742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-65a89ba9-a912-4e39-924f-92b366227427 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1517 microversion: 2.1 time: 0.167887 Jul 18 14:20:14.539315 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 102/179] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:14 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1517 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:14.543856 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:14.544437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:14.551468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.551919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.552686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.553117 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.573138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:14.711731 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.719604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-74780ea3-6f1d-492c-b5c2-1556592e522f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1367 microversion: 2.1 time: 0.179296 Jul 18 14:20:14.720888 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 103/180] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:14 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:14.730201 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7acf572f-98c3-49e6-a69b-1383abd081ef tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:14.730807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7acf572f-98c3-49e6-a69b-1383abd081ef tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:14.794114 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7acf572f-98c3-49e6-a69b-1383abd081ef tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:14.813072 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7acf572f-98c3-49e6-a69b-1383abd081ef tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1218 microversion: 2.1 time: 0.090869 Jul 18 14:20:14.818437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 104/181] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:14 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:14.837337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:14.845509 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:14.862451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.863104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.868617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:14.872022 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:14.909951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lazy-loading 'flavor' on Instance uuid 7677bd33-c598-4302-a355-13c48bca9e32 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:20:15.016377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e42af07b-fdd9-4665-860a-ab6323fa7df6 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "POST /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.279403 Jul 18 14:20:15.019709 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 78/182] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:20:09 2022] POST /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e/os-volume_attachments => generated 194 bytes in 5283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:15.028193 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.029066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.034783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=92 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:15.052248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.053110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.053940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.054380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.069194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-677a6934-edef-4b67-9855-4089fa5ec27c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32/action" status: 200 len: 32 microversion: 2.1 time: 0.248627 Jul 18 14:20:15.070144 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 105/183] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:20:14 2022] POST /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:20:15.082598 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.083953 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.091443 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.091898 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.092668 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.093104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.280616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:15.290739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-13812dd9-542d-44b8-a5f1-616a06c14661 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1546 microversion: 2.1 time: 0.267691 Jul 18 14:20:15.291334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 79/184] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1546 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:15.296353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:15.308328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ded85bdc-eec7-49d5-90de-f19ebdc91ae9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.230823 Jul 18 14:20:15.308857 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 106/185] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:15.311147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.311825 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.319107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.319553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.320332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.320758 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.419909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bc75ca3a-cefc-4623-b8ab-f918a5ccc0ea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.113533 Jul 18 14:20:15.420634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 80/186] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:15.738466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.739435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.747700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.748115 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.748896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.749322 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.837331 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.839040 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.847306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.848058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.849102 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.849547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.907685 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:15.916727 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9c1c67e6-3844-4ce5-b691-d6ade2224d01 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1556 microversion: 2.1 time: 0.182739 Jul 18 14:20:15.917305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 107/187] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1556 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:15.926145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:15.934114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-10868da5-23cc-4337-b9fc-043fc9ad198a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1222 microversion: 2.1 time: 0.100771 Jul 18 14:20:15.934674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 81/188] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1222 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:15.934797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:15.935269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:15.941726 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.942491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:15.943331 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:15.943839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.028747 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9656d2cd-c743-4d6e-9fd2-16c0fbc1e7e1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097705 Jul 18 14:20:16.029409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 108/189] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:20:15 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:16.335394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:16.337167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:16.345175 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.346915 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.348409 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.349238 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.547124 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:16.557171 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-36b7531e-bffa-4805-a27e-8ddcf762b729 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.225451 Jul 18 14:20:16.557800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 82/190] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:16 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:16.865828 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-890d7a10-eb21-42db-b378-2fb9f89fcc76 req-8e268593-b045-414f-9cf4-a994db5d7e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3954bb52-b979-4fd0-84c0-c95c060085eb", "tag": "38d0ae5e-b6aa-4c94-b263-4e607bc0997c"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:16.882989 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-890d7a10-eb21-42db-b378-2fb9f89fcc76 req-8e268593-b045-414f-9cf4-a994db5d7e6d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.883427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-890d7a10-eb21-42db-b378-2fb9f89fcc76 req-8e268593-b045-414f-9cf4-a994db5d7e6d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.896544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-890d7a10-eb21-42db-b378-2fb9f89fcc76 req-8e268593-b045-414f-9cf4-a994db5d7e6d service nova] Creating event network-changed:38d0ae5e-b6aa-4c94-b263-4e607bc0997c for instance 3954bb52-b979-4fd0-84c0-c95c060085eb on hv-cinder-79760 Jul 18 14:20:16.902769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-890d7a10-eb21-42db-b378-2fb9f89fcc76 req-8e268593-b045-414f-9cf4-a994db5d7e6d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041408 Jul 18 14:20:16.903659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 109/191] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:16.953522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:16.954195 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:16.963460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.964118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:16.964910 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:16.965342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:17.145450 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:17.156977 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5739360e-5b7a-4189-8cab-b0f14b31b791 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1214 microversion: 2.1 time: 0.208954 Jul 18 14:20:17.162619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 83/192] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:16 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1214 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:17.585100 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:17.587010 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:17.605613 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:17.609551 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:17.611499 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:17.612995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:17.882022 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:17.893815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d7057b3f-45bd-41fc-8444-277e33f7d36f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.321026 Jul 18 14:20:17.897829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 110/193] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:17 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:18.180509 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:18.181567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:18.193205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:18.194073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:18.195462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:18.196267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:18.584110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:18.597785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-822334fd-b482-4434-aeda-f7e5d987ef6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1278 microversion: 2.1 time: 0.421830 Jul 18 14:20:18.598935 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 84/194] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:18 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1278 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:18.916532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:18.919234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:18.924114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-9391f01a-2ac6-402f-92a9-e969f96cc83d req-9afd005d-3c1f-40a1-97f0-afb205ec99fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da73439b-b34f-42fb-b28a-9fa41604ab3c", "tag": "869acbfc-dc56-4f1c-9dac-151d00c2f5e8"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:18.934856 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:18.935554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:18.937263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:18.939008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:18.939672 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-9391f01a-2ac6-402f-92a9-e969f96cc83d req-9afd005d-3c1f-40a1-97f0-afb205ec99fe service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:18.940428 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-9391f01a-2ac6-402f-92a9-e969f96cc83d req-9afd005d-3c1f-40a1-97f0-afb205ec99fe service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:18.974860 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-9391f01a-2ac6-402f-92a9-e969f96cc83d req-9afd005d-3c1f-40a1-97f0-afb205ec99fe service nova] Creating event network-changed:869acbfc-dc56-4f1c-9dac-151d00c2f5e8 for instance da73439b-b34f-42fb-b28a-9fa41604ab3c on hv-cinder-79760 Jul 18 14:20:18.986214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-9391f01a-2ac6-402f-92a9-e969f96cc83d req-9afd005d-3c1f-40a1-97f0-afb205ec99fe service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066488 Jul 18 14:20:18.986895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 85/195] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:19.487203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:19.496901 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f2f4a241-2c8a-4576-b0c2-0b7f711ba5fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.587596 Jul 18 14:20:19.497541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 111/196] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:18 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:19.624805 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:19.625519 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:19.647300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:19.647766 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:19.650615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:19.651052 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:19.733646 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:19.742534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1b30e460-69cc-4318-ae92-a4eb10f6bfff tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1276 microversion: 2.1 time: 0.124614 Jul 18 14:20:19.743118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 86/197] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:19 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1276 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:20.529887 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:20.532352 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:20.540867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.541799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.542937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.543904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.760204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:20.761745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:20.768245 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.768744 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:20.769530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:20.769995 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:21.184247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:21.195422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d13b6256-8296-449d-85ac-61b076a252ac tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.671829 Jul 18 14:20:21.196189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 112/198] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:20 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:21.217280 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:21.226679 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-263b8e63-3285-4a87-9f86-2c65f6809c66 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.470393 Jul 18 14:20:21.239772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 87/199] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:20 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:21.400861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-26ce2d12-4eb0-4480-8025-d58e302fe76e req-1114def8-671c-4a31-9d56-b850b916d0f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e", "tag": "55d29a21-a693-4955-b103-cbbaeaccf89d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:21.413167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-26ce2d12-4eb0-4480-8025-d58e302fe76e req-1114def8-671c-4a31-9d56-b850b916d0f2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:21.414688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-26ce2d12-4eb0-4480-8025-d58e302fe76e req-1114def8-671c-4a31-9d56-b850b916d0f2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:21.435330 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-26ce2d12-4eb0-4480-8025-d58e302fe76e req-1114def8-671c-4a31-9d56-b850b916d0f2 service nova] Creating event network-changed:55d29a21-a693-4955-b103-cbbaeaccf89d for instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e on hv-cinder-79760 Jul 18 14:20:21.442121 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-26ce2d12-4eb0-4480-8025-d58e302fe76e req-1114def8-671c-4a31-9d56-b850b916d0f2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045634 Jul 18 14:20:21.443015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 113/200] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:22.213982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:22.215559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:22.223271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:22.223697 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:22.224773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:22.225318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:22.246186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:22.247018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:22.254643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:22.255150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:22.256030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:22.256559 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:22.438322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:22.450943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86b6ee96-41b7-41ce-99a4-446e28cd257d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.242319 Jul 18 14:20:22.453194 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 88/201] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:22 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:22.467227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:22.477614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-534cf3f5-f969-4040-9735-cd73f075bcdb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.236285 Jul 18 14:20:22.484158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 114/202] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:22 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:23.472370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:23.472370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:23.479114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:23.479584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:23.484606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:23.484606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:23.501474 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:23.503366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:23.510979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:23.511432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:23.512391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:23.512977 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:23.768279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:23.779612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-877fb929-1f45-4b6f-bc24-1a20ac868e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.313957 Jul 18 14:20:23.780212 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 89/203] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:23 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:23.804985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:23.813051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-60bca8f2-2274-4998-bd97-306413ffd08a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.316205 Jul 18 14:20:23.815759 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 115/204] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:23 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:24.801192 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:24.802552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:24.819883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:24.820504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:24.821565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:24.822214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:24.834775 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:24.835976 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:24.838366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:24.839316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=8 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:24.847106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:24.847688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:24.848678 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:24.849248 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:25.088251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:25.091433 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:25.099289 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7e1566d3-9a67-446f-9ea2-3f0403544d34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.270215 Jul 18 14:20:25.099472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3ce9bac9-ea8a-48fa-96fa-448be285b4e6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.306111 Jul 18 14:20:25.105708 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 116/205] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:24 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:25.109510 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 90/206] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:24 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:25.913032 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-c7dc082a-3853-4cf7-9a3d-8c48359f93e3 req-6ee271d3-9490-4f5c-a234-78481027571d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e", "name": "network-vif-plugged", "status": "completed", "tag": "55d29a21-a693-4955-b103-cbbaeaccf89d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:25.921432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c7dc082a-3853-4cf7-9a3d-8c48359f93e3 req-6ee271d3-9490-4f5c-a234-78481027571d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:25.921993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c7dc082a-3853-4cf7-9a3d-8c48359f93e3 req-6ee271d3-9490-4f5c-a234-78481027571d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:25.935165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-c7dc082a-3853-4cf7-9a3d-8c48359f93e3 req-6ee271d3-9490-4f5c-a234-78481027571d service nova] Creating event network-vif-plugged:55d29a21-a693-4955-b103-cbbaeaccf89d for instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e on hv-cinder-79760 Jul 18 14:20:25.940499 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-c7dc082a-3853-4cf7-9a3d-8c48359f93e3 req-6ee271d3-9490-4f5c-a234-78481027571d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031241 Jul 18 14:20:25.941111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 117/207] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:20:26.117930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:26.118541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:26.118686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:26.119243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:26.125922 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:26.126367 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:26.126549 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:26.127082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:26.127280 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:26.127737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:26.128049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:26.128490 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:26.482628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:26.498267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6f845b06-61dc-46ca-b552-fb87b3fe5c4e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.381308 Jul 18 14:20:26.498267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 118/208] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:26 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:26.527136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:26.535680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8a9b151d-78a1-4863-9382-43453d61ea5c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.421879 Jul 18 14:20:26.536205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 91/209] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:26 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:27.135279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:27.135861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:27.141822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.142343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.143193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.143594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.171622 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:20:27.234079 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:27.268641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c4c588f4-da85-4223-b4aa-a97708d6b0ef tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 204 len: 0 microversion: 2.1 time: 0.136917 Jul 18 14:20:27.269238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 119/210] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:27 2022] DELETE /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:20:27.278209 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:27.278809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:27.285329 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.285828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.286618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.287047 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.423205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:27.431895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bb1d9cd8-a226-4b89-9ba2-76a020c5837f tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1554 microversion: 2.1 time: 0.158104 Jul 18 14:20:27.432473 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 92/211] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:27 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:27.514593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:27.515288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:27.522058 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.522511 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.523286 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.523722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.554506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:27.555137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:27.561175 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.561621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.562420 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:27.562869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:27.715851 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:27.724134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6c4040ce-400a-4576-a46e-3b3f210c519b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.213733 Jul 18 14:20:27.725149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 120/212] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:27 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:27.755551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:27.763147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a8aeb6b5-7993-4816-abae-73778d100d99 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.212493 Jul 18 14:20:27.763811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 93/213] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:27 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:28.450714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:28.451314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:28.458109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:28.458783 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:28.459913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:28.460650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:28.683555 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:28.693074 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9bb4e5c8-fb64-4dde-a416-738deb0c18a0 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1554 microversion: 2.1 time: 0.246437 Jul 18 14:20:28.704356 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 121/214] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:28 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1554 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:28.741797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:28.742594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:28.749694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:28.750144 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:28.751022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:28.751392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:28.780342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:28.780961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:28.787947 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:28.788656 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:28.789760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:28.790579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:28.962985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:28.979293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bf035478-5786-4643-8927-d73a7c50a2be tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.241767 Jul 18 14:20:28.991494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 94/215] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:28 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:28.998333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:29.009123 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-df45a3e2-1a7d-40ea-a15e-91280440a339 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.232539 Jul 18 14:20:29.010323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 122/216] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:28 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:29.711966 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:29.713036 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:29.719318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:29.719769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:29.720805 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:29.721214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:29.725806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:29.870342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:29.880371 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8f6e4f6a-81f5-4a9d-968c-19c96d3fabeb tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1554 microversion: 2.1 time: 0.172323 Jul 18 14:20:29.881141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 95/217] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:29 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:29.999999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:30.002167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:30.011528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:30.012267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:30.013524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:30.014311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:30.027214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:30.027833 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:30.039019 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:30.039777 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:30.040724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:30.041319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:30.261230 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:30.270311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-46357361-eb0c-45ee-bf0a-77c0fa6b51c7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1318 microversion: 2.1 time: 0.274674 Jul 18 14:20:30.281808 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 123/218] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:29 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:30.307234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:30.318767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-94ab6bf2-5e7d-43ba-92a6-838a6b1062e5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.295088 Jul 18 14:20:30.319634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 96/219] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:30 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:30.899200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:30.899811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:30.906349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:30.906797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:30.907571 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:30.908398 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:31.056926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:31.066969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5bb1ae8d-aea6-4568-bec7-841a0909f5aa tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1554 microversion: 2.1 time: 0.171711 Jul 18 14:20:31.067554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 124/220] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:30 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:31.290530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:31.291147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:31.297876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:31.298319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:31.301130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:31.301837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:31.335683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:31.336293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:31.342637 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:31.343086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:31.343870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:31.344306 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:31.679094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:31.689863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eca987a3-62df-4f0d-8a73-53a62d01a719 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1507 microversion: 2.1 time: 0.401780 Jul 18 14:20:31.690623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 97/221] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:31 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1507 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:31.698962 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:31.707436 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2034d351-ed38-421b-a43e-79bbe6fa32ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.375534 Jul 18 14:20:31.708295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 125/222] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:31 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:32.086294 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:32.086920 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:32.094894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:32.095489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:32.096659 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:32.097108 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:32.206334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:32.221534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-866d86fa-1b27-4f7b-817b-b45297c4a027 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1512 microversion: 2.1 time: 0.139982 Jul 18 14:20:32.222715 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 98/223] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:32 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1512 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:32.293462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-2b58f12f-8482-4ef6-a563-b49e14876278 req-0814eee4-9309-44ab-95b7-1bdd9a6a5cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e", "name": "network-vif-deleted", "tag": "df66f71e-315b-4540-a22d-369f45a277c8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:20:32.303277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2b58f12f-8482-4ef6-a563-b49e14876278 req-0814eee4-9309-44ab-95b7-1bdd9a6a5cbe service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:32.303277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2b58f12f-8482-4ef6-a563-b49e14876278 req-0814eee4-9309-44ab-95b7-1bdd9a6a5cbe service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:32.324464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-2b58f12f-8482-4ef6-a563-b49e14876278 req-0814eee4-9309-44ab-95b7-1bdd9a6a5cbe service nova] Creating event network-vif-deleted:df66f71e-315b-4540-a22d-369f45a277c8 for instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e on hv-cinder-79760 Jul 18 14:20:32.340595 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-2b58f12f-8482-4ef6-a563-b49e14876278 req-0814eee4-9309-44ab-95b7-1bdd9a6a5cbe service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050200 Jul 18 14:20:32.340595 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 126/224] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:20:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:20:32.725621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:32.727071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:32.733374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:32.733890 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:32.734623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:32.735214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:32.887699 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:32.900020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-83f2576f-b858-444a-ab50-f20ccae19141 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.178722 Jul 18 14:20:32.900730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 99/225] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:32 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:33.241596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:33.242311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:33.244902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:33.253407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:33.254011 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:33.254795 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:33.255234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:33.293029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:33.293477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:33.293956 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lazy-loading 'fault' on Instance uuid c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:20:33.564793 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2e3c7eb6a5cb4515b6f48520535fea76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8788b8d25f234df6895ea3f8fa046610', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:33.572323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-213b02db-fb0d-4471-95ec-e109c88f8395 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 200 len: 1305 microversion: 2.1 time: 0.336471 Jul 18 14:20:33.572917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 127/226] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:33 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 1305 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:33.918499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:33.919129 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:33.926364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:33.926806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:33.927569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:33.927998 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:34.074689 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:34.083767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-17010796-2ad6-497f-9f6b-b0353d9135e7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.169276 Jul 18 14:20:34.084337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 100/227] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:33 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:34.590555 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:34.591342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:34.597566 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:34.598065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:34.598810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:34.599391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:34.614124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] HTTP exception thrown: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Request method failure captured: Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e HTTP/1.1 Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvl58pwyK2A6IoVTiJ_PuVe1yrx1i97Lb82z4xXcqbcY81rttVNtVirk_vv3A43z_KtRWvK9ujrE7u6VQCmV---bhwAopmxvjgFMPVFwbmy64c3k1E1FpcftG-XF7ItCjM6gnQ2LUM3F2P8PgmPYEImhJKULD1bCOxDCIydBuRTVfg Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:20:34.618836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8788b8d25f234df6895ea3f8fa046610", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 2e3c7eb6a5cb4515b6f48520535fea76 Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.620129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e'} Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:34.620806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.622000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.623063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Returning 404 to user: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:34.623063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0e1aaa87-e84a-421b-9327-8b541a04afc5 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 404 len: 111 microversion: 2.1 time: 0.033615 Jul 18 14:20:34.623063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 128/228] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:34 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:34.748022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:34.749045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:34.755901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:34.756354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:34.757139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:34.757573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:34.770721 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] HTTP exception thrown: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Request method failure captured: Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e/os-volume_attachments HTTP/1.1 Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvl58pwyK2A6IoVTiJ_PuVe1yrx1i97Lb82z4xXcqbcY81rttVNtVirk_vv3A43z_KtRWvK9ujrE7u6VQCmV---bhwAopmxvjgFMPVFwbmy64c3k1E1FpcftG-XF7ItCjM6gnQ2LUM3F2P8PgmPYEImhJKULD1bCOxDCIydBuRTVfg Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:20:34.774934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8788b8d25f234df6895ea3f8fa046610", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 2e3c7eb6a5cb4515b6f48520535fea76 Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.776376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'server_id': 'c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e'} Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:34.777152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:34.778235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:34.779283 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Returning 404 to user: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:34.779283 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d42658e9-e8ec-44ec-9951-8558f945fe58 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035310 Jul 18 14:20:34.779283 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 101/229] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:20:34 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:35.101486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:35.102009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:35.109587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:35.110163 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:35.111051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:35.111556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:35.273978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:35.283300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8894d881-b077-4fb8-8347-4239982fe337 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.186223 Jul 18 14:20:35.284819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 129/230] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:35 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:36.003387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:36.003906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:36.010205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.010658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.011461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.011897 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.026415 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] HTTP exception thrown: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Request method failure captured: Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e HTTP/1.1 Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvl58pwyK2A6IoVTiJ_PuVe1yrx1i97Lb82z4xXcqbcY81rttVNtVirk_vv3A43z_KtRWvK9ujrE7u6VQCmV---bhwAopmxvjgFMPVFwbmy64c3k1E1FpcftG-XF7ItCjM6gnQ2LUM3F2P8PgmPYEImhJKULD1bCOxDCIydBuRTVfg Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:20:36.028680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8788b8d25f234df6895ea3f8fa046610", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 2e3c7eb6a5cb4515b6f48520535fea76 Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.030068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e'} Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:36.030828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.032407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.044490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Returning 404 to user: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:36.044490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e3a1e5ed-d013-4e7a-ae0b-e246772f0540 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 404 len: 111 microversion: 2.1 time: 0.030807 Jul 18 14:20:36.044490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 102/231] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:20:35 2022] DELETE /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:20:36.045859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:36.045859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] [instance: c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:36.047743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.049153 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.049343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.049630 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.064974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] HTTP exception thrown: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Request method failure captured: Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e HTTP/1.1 Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvl58pwyK2A6IoVTiJ_PuVe1yrx1i97Lb82z4xXcqbcY81rttVNtVirk_vv3A43z_KtRWvK9ujrE7u6VQCmV---bhwAopmxvjgFMPVFwbmy64c3k1E1FpcftG-XF7ItCjM6gnQ2LUM3F2P8PgmPYEImhJKULD1bCOxDCIydBuRTVfg Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:20:36.066391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/8788b8d25f234df6895ea3f8fa046610"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_8788b8d25f234df6895ea3f8fa046610", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 8788b8d25f234df6895ea3f8fa046610 Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-DeleteServersTestJSON-1631651512 Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 2e3c7eb6a5cb4515b6f48520535fea76 Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-DeleteServersTestJSON-1631651512-project Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.067854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e'} Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:20:36.068633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. Jul 18 14:20:36.070142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:20:36.071387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] Returning 404 to user: Instance c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:20:36.071387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7d0027cc-4193-4abc-965b-89d5ea016ac8 tempest-DeleteServersTestJSON-1631651512 tempest-DeleteServersTestJSON-1631651512-project] 10.222.0.71 "GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e" status: 404 len: 111 microversion: 2.1 time: 0.032576 Jul 18 14:20:36.071387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 130/232] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:36 2022] GET /compute/v2.1/servers/c5e5c7cf-8599-4b0e-a1e9-044da6fc1f1e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:20:36.306814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:36.308429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:36.316259 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.316816 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.317629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:36.318150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:36.651920 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:36.660517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-272732f5-1a33-448e-b027-5d06c7161d78 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.359889 Jul 18 14:20:36.669724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 103/233] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:36 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:37.678334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:37.680987 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:37.687193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:37.687721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:37.688926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:37.689594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:38.142307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:38.157619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-74ef3c7c-61ab-4c88-81b8-9137a547243f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.483210 Jul 18 14:20:38.159692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 131/234] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:37 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:39.175093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:39.175708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:39.185615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:39.186106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:39.186850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:39.198631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:39.445886 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:39.453901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c6ccf014-1184-4ab0-b5f0-f4df4520851e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.282990 Jul 18 14:20:39.464528 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 104/235] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:39 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:40.476871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:40.489395 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:40.503864 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:40.504585 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:40.505990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:40.506762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:40.679850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:40.687775 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-17e3a4ea-b6ed-4c01-b1f2-cd197449258f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.218801 Jul 18 14:20:40.697278 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 132/236] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:40 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:41.706945 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:41.708346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:41.715821 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:41.716665 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:41.718142 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:41.718593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:42.000206 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:42.008683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f1018ac7-2c7f-4b2b-859a-f53a2e5463b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.307724 Jul 18 14:20:42.009693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 105/237] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:41 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:43.026991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:43.027668 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:43.034655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:43.035581 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:43.036399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:43.036815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:43.404592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:43.415476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-58b93fa1-736d-42f7-975b-1e7a12ba1de3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.392498 Jul 18 14:20:43.416053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 133/238] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:43 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:20:44.433109 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:44.433827 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:44.441288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:44.442755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:44.443721 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:44.444885 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:44.647451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:44.671366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-097de2dc-eb05-4d01-92f6-b91d2935bb6c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.242617 Jul 18 14:20:44.672113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 106/239] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:44 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:45.689798 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:45.690452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:45.697176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:45.697770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:45.698600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:45.699236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:45.938152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:45.947718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-87e259d9-e449-4cd9-91f2-ed3b240a7cc9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.262231 Jul 18 14:20:45.958463 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 134/240] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:45 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:46.967679 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:46.968298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:46.971366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=56 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:46.978418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:46.979251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:46.980233 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:46.981122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:47.164734 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:47.174163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d376cb0e-367e-4762-83f8-5f69fc2c4b14 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.210750 Jul 18 14:20:47.175020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 107/241] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:46 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:48.195382 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:48.196193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:48.205574 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:48.206236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:48.207060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:48.207594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:48.382300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:48.390429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1280d28c-7f60-4de4-9903-a79fb08d075e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.201465 Jul 18 14:20:48.391236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 135/242] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:48 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:49.409575 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:49.410317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:49.417275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:49.417985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:49.419043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:49.419583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:49.585726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:49.597835 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-617981cb-7a91-4207-b073-36883dd90b9a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.192266 Jul 18 14:20:49.598881 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 108/243] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:49 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:50.617316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:50.617918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:50.624026 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:50.624472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:50.625238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:50.625680 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:50.796306 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:50.804317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cefeaac2-06eb-42a8-b643-8baa6ba7811d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.191265 Jul 18 14:20:50.804887 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 136/244] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:50 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:51.822639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:51.823241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:51.832127 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:51.832601 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:51.833407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:51.833899 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:51.990064 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:51.999461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-faf82494-5df1-4a5a-8d3f-44ee1933b302 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.180452 Jul 18 14:20:52.000169 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 109/245] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:51 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:53.019708 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:53.020345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:53.026830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:53.027279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:53.028087 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:53.028524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:53.168234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:53.176603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3eee014b-fb5e-4c66-b923-c343421f6148 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.160938 Jul 18 14:20:53.177218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 137/246] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:53 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:54.195039 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:54.195586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:54.202833 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:54.203282 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:54.204059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:54.204495 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:54.362733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:54.371474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-29fdb0c3-25dc-4f87-934f-a7909c9c1ae2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.180779 Jul 18 14:20:54.372074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 110/247] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:54 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:55.388740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:55.389392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:55.395902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:55.396593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:55.397368 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:55.397945 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:55.402399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:20:55.540099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:55.547946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-529f651b-a56e-4f70-b40f-4ee3f59494d1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.163251 Jul 18 14:20:55.548462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 138/248] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:55 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:56.564720 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:56.565315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:56.572213 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:56.572737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:56.573631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:56.574094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:56.715000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:56.726552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-909dbe35-ed41-4bb9-bf22-e092d24fd7f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.165785 Jul 18 14:20:56.727234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 111/249] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:56 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:57.745175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:57.745810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:57.752636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:57.753087 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:57.753906 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:57.754341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:57.896508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:57.909308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b10f1830-61be-4d10-bdbd-5a7b2c93a165 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.167824 Jul 18 14:20:57.910550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 139/250] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:57 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:20:58.932870 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:20:58.933431 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:20:58.940581 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:58.941026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:58.941820 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:20:58.942244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:20:59.087078 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:20:59.094706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0dd26fb6-7705-413f-9362-fc695f37c63a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.165992 Jul 18 14:20:59.095285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 112/251] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:20:58 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:00.112726 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:00.113324 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:00.120216 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:00.120705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:00.121466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:00.121932 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:00.266987 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:00.275399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aa065bc3-d845-4613-a90e-9b1d98225786 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.166541 Jul 18 14:21:00.275985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 140/252] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:00 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:01.295247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:01.295901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:01.303311 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:01.303979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:01.304972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:01.305648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:01.311285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:01.449833 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:01.458167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-852ff2bc-730e-4835-8649-8ffa560299cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.168949 Jul 18 14:21:01.458611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 113/253] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:01 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:02.041496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7ce7ed4-ed87-4ee6-b6d8-55adf67c615d", "device": "/dev/sdb"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:02.043131 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:02.049269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:02.049743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:02.050589 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:02.050921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:02.383537 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d80fbab9-c39f-4ab8-9496-57a36924556a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "POST /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345827 Jul 18 14:21:02.384380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 141/254] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:21:02 2022] POST /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e/os-volume_attachments => generated 194 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:02.477399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:02.477399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:02.486486 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:02.487162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:02.488705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:02.489330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:02.632301 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:02.640948 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a102259a-d01b-4ae0-afcd-5b00f7d379dc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.169027 Jul 18 14:21:02.641583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 114/255] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:02 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:03.664806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:03.666171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:03.668143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=32 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:03.673962 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:03.674399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:03.675200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:03.675656 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:03.815747 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:03.824190 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-205b10e3-cccb-4ca4-9e2e-35efd77971e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.164669 Jul 18 14:21:03.824786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 142/256] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:03 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:04.847335 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:04.848235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:04.857049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:04.857579 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:04.858447 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:04.858935 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:05.024374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:05.032215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f3d9ef24-5d1a-4f2b-ae16-37f67ea894c5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.190654 Jul 18 14:21:05.032787 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 115/257] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:04 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:06.049943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:06.049943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:06.057014 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:06.057909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:06.058634 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:06.059068 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:06.199695 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:06.211234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7b05976f-6dbf-4d33-8863-ed75df9a74fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.165913 Jul 18 14:21:06.211737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 143/258] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:06 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:07.228833 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:07.229636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:07.237600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:07.238081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.239177 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:07.239609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:07.394716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:07.405835 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e4e200dd-9530-483d-990c-d4f608fedff2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.180893 Jul 18 14:21:07.406594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 116/259] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:07 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:08.424854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:08.425452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:08.432991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:08.433442 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:08.434252 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:08.434684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:08.587671 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:08.596391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e4e29696-c42f-45ce-bfbc-de0b0f01cb55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.175505 Jul 18 14:21:08.596971 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 144/260] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:08 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:09.615033 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:09.615833 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:09.634688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:09.635592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:09.636611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:09.637202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:10.065603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:10.073981 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-52ddd2b5-9748-4f89-b15d-57f5d764fe62 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.463647 Jul 18 14:21:10.074467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 117/261] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:09 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:11.093516 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:11.094640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:11.102067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:11.102910 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:11.104089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:11.104801 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:11.257414 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:11.265290 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-95f29a39-4fe3-4e68-a46e-e92b804f0739 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.176488 Jul 18 14:21:11.265990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 145/262] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:11 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:12.282690 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:12.283964 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:12.292616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:12.293393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:12.294461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:12.295149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:12.467992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:12.477160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0666145f-9f50-4a5a-a7b0-6acb9cc30a8f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.198344 Jul 18 14:21:12.478121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 118/263] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:12 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:13.497987 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:13.499346 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:13.507205 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.508033 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.509060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:13.509626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:13.669485 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:13.677377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bd3d5a56-29c0-4e46-8355-0dd884ba5231 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.185062 Jul 18 14:21:13.677979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 146/264] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:13 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:14.697031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:14.697815 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:14.705684 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:14.714575 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:14.715546 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:14.716168 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:14.889011 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:14.897460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e3221295-193a-4c40-bade-ffa636397f8a tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1523 microversion: 2.1 time: 0.206699 Jul 18 14:21:14.898358 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 119/265] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:14 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1523 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:15.915980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:15.916679 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:15.927625 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:15.928262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:15.930143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:15.930770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.175627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:16.186170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1c912564-9ced-4c62-af32-84dd6d3e57e4 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1503 microversion: 2.1 time: 0.275029 Jul 18 14:21:16.187887 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 147/266] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:15 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:16.203191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:16.203816 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:16.211746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:16.212210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.213218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:16.213846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:16.476752 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:16.492924 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9c32ee5e-5233-4339-814d-a20629475ea0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1516 microversion: 2.1 time: 0.293284 Jul 18 14:21:16.495518 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 120/267] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:16 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1516 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:18.193176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:18.195532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:18.205586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.206090 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.207244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.208028 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.254634 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lazy-loading 'flavor' on Instance uuid fedbc653-17b5-4127-8c87-b446551d81dc {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:21:18.391421 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c33214d7-89ac-432a-9018-600f4a54b329 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/action" status: 200 len: 32 microversion: 2.1 time: 0.203905 Jul 18 14:21:18.397164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 148/268] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:21:18 2022] POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/action => generated 32 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:21:18.416388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:18.417507 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:18.428348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=28 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:18.449554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.450405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.452326 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.453534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.688505 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:18.699744 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-df0970d2-72f3-4dba-9a32-6dd4973e950c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.301438 Jul 18 14:21:18.701122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 121/269] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:18 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:18.957140 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:18.957956 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:18.971416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.971866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:18.972787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:18.973249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:19.013032 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a4f35f19-b7e2-4fe6-86d2-ec8ea29efd72 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/ips" status: 200 len: 152 microversion: 2.20 time: 0.061545 Jul 18 14:21:19.013621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 149/270] 10.222.0.71 () {60 vars in 1288 bytes} [Mon Jul 18 14:21:18 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/ips => generated 152 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:21:19.720547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:19.721435 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:19.729204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:19.729701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:19.730700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:19.731351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:19.931251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:19.943288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cb0dc989-9dc9-4cc1-9106-aed50bf16565 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.226671 Jul 18 14:21:19.947006 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 122/271] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:19 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:20.970709 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:20.972065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:20.978972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:20.979420 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:21.000214 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:21.001175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:21.169364 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:21.182959 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-32e666f7-5d0e-48d6-b6e9-2d4cd0d3cf04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.221347 Jul 18 14:21:21.184858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 150/272] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:20 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:22.205107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:22.207231 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:22.224418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:22.226429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:22.231641 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:22.234813 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:22.591189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:22.600737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-58582aa2-ea74-4b9d-ab04-d8613d01873f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.402448 Jul 18 14:21:22.601618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 123/273] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:22 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:23.621812 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:23.622515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:23.633213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:23.639995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:23.640954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:23.642898 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:23.832748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:23.833458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:23.847050 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:23.858404 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:23.860065 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:23.860899 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:23.904860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:23.909415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:23.918659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fb7e9cc9-7491-4590-a4e6-38312d8ee19d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.303753 Jul 18 14:21:23.928624 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 151/274] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:23 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:23.956083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lazy-loading 'flavor' on Instance uuid c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:21:24.502216 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-385250a0-f1e7-4eef-9209-28f72775b01d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/action" status: 202 len: 0 microversion: 2.20 time: 0.673008 Jul 18 14:21:24.503332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 124/275] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 18 14:21:23 2022] POST /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/action => generated 0 bytes in 675 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:21:24.512474 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:24.515543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:24.524006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:24.524431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:24.526642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:24.527115 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:24.856724 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:24.871421 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:24.873769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:24.875381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-604f6e4e-5786-41b4-8041-92946c5d4248 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.367618 Jul 18 14:21:24.891538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 152/276] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:24 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:24.942852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:24.945005 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:24.963544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:24.965854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:24.967688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:24.968421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:25.187448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:25.196059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7e3b756c-e20b-452e-a3e3-90541862eb20 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.262859 Jul 18 14:21:25.197896 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 125/277] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:24 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:25.680239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:25.680737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:25.689409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:25.690073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:25.691434 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:25.691883 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:25.729590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7d9b609a-926f-491e-9f31-8d1add0fa054 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/ips" status: 200 len: 144 microversion: 2.1 time: 0.054554 Jul 18 14:21:25.730619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 153/278] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:21:25 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/ips => generated 144 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:25.899491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:25.900085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:25.908991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:25.909438 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:25.910873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:25.911310 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:26.116085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:26.127915 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:26.129959 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:26.131370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-574ce349-7c4d-46b0-87af-d8f3239d0f12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.236178 Jul 18 14:21:26.132043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 126/279] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:25 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:26.215158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:26.216795 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:26.226606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:26.228290 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:26.229932 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:26.231573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:26.438653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:26.450362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5bb360c8-979c-4ec3-a00a-718d773121f3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.240161 Jul 18 14:21:26.454099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 154/280] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:26 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:26.584350 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:26.584851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:26.596585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:26.596971 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:26.597965 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:26.598201 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:26.628260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d97cfea4-4314-4e42-80fc-f078dfe0acb8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/ips" status: 200 len: 149 microversion: 2.1 time: 0.047877 Jul 18 14:21:26.635619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 127/281] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:21:26 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:27.153502 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:27.154400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:27.169376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:27.170289 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:27.171461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:27.172045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:27.374888 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:27.386685 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:27.389083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:27.390958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dd7c7cf4-9349-4db7-8a45-9632c8371e1f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.242885 Jul 18 14:21:27.392021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 155/282] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:27 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:27.469364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:27.470236 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:27.482481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:27.483445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:27.487616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:27.488633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:27.492083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:27.704061 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:27.715059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3fead4df-ec8b-494b-9133-073973c10a2c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.249598 Jul 18 14:21:27.715806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 128/283] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:27 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:28.413624 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:28.414949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:28.432812 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:28.433265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:28.434097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:28.434536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:28.642009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:28.652655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:28.654179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:28.655593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bd6e3fa5-5bca-4206-bfef-b1458a442630 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.246203 Jul 18 14:21:28.656174 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 156/284] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:28 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:28.742488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:28.743903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:28.750978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:28.751674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:28.752676 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:28.753274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:29.099230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:29.116258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-da9bc74c-4cac-47d8-b51f-c37068ed3145 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.379178 Jul 18 14:21:29.117007 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 129/285] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:28 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:29.675612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:29.676265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:29.683467 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:29.684231 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:29.685211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:29.685878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:29.957361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:29.970569 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:29.973134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:29.975821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5942670e-16c6-4fa2-9212-13ecb05c4790 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.304373 Jul 18 14:21:29.990746 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 157/286] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:29 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:30.145391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:30.147758 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:30.162957 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:30.166292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:30.166599 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:30.167054 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:30.461426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:30.483751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-59be6ac5-5f63-4722-b900-1ce1b54eab27 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.353533 Jul 18 14:21:30.495050 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 130/287] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:30 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:30.998583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:31.000015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:31.008071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:31.008534 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:31.009319 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:31.009830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:31.311426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:31.323888 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:31.326001 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:31.329540 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2a9eab5f-2e3c-4090-89a8-03bf7841134b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.333572 Jul 18 14:21:31.330799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 158/288] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:30 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:31.503866 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:31.504658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:31.513764 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3284d44-d7ea-4716-8172-ada3ccfba70c"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:31.514854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:31.526202 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:31.528561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:31.533994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:31.534460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:31.535277 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:31.535720 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:31.538415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:31.538935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:31.815619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:31.830302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ff4268b8-88fe-4cec-988a-0940688def55 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.331754 Jul 18 14:21:31.835440 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 131/289] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:31 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:31.968313 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-950d2c85-d85a-4b19-aa83-3193def86daa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.459378 Jul 18 14:21:31.969258 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 159/290] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:21:31 2022] POST /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:21:32.282850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "def0a592-45fd-4933-872d-758e1f03ff1e"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:32.287838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:32.303665 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:32.304346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:32.305820 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:32.308184 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:32.349227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:32.352327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:32.370228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:32.370780 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:32.371659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:32.372169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:32.669100 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:32.685139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:32.689802 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:32.692967 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4d65a473-99f7-4842-be86-6c5525a1e39c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.347958 Jul 18 14:21:32.695103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 160/291] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:32 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:32.856749 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:32.859461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ddb625c7-3ea5-4060-a098-974d7cabfc66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.581032 Jul 18 14:21:32.860028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 132/292] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:21:32 2022] POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-volume_attachments => generated 194 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:32.860538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:32.920118 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:32.924259 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:32.925262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:32.925717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:33.106111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:33.116504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f75e2fd6-9274-4aea-a00c-bae240084d98 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.270577 Jul 18 14:21:33.117295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 161/293] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:32 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:33.713888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:33.714609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:33.733961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:33.734552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:33.735354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:33.735798 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:33.927397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:33.939627 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:33.942994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:33.947247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d9185695-1e57-4ee9-9312-cf2ec5377615 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.235814 Jul 18 14:21:33.948327 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 133/294] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:33 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:34.135287 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:34.148579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:34.170337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=40 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:34.173555 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:34.174358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:34.175515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:34.181246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:34.356831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:34.369056 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-162934cd-6350-4c5a-82bc-e5ca7eb740bd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.238450 Jul 18 14:21:34.378765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 162/295] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:34 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:34.828285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:34.828887 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:34.846983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:34.846983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:34.846983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:34.846983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:34.981263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:34.982417 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:34.998033 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.000469 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.001373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.003033 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.102317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lazy-loading 'services' on Instance uuid c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:21:35.251563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:35.264941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:35.266832 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:35.268536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9bf41dfb-61c4-4995-aa8a-6dc4c801d473 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.290991 Jul 18 14:21:35.269787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 163/296] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:34 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:35.316647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-72dd4623-c5d7-43c3-bfa4-ee78f1b27f7b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e/os-volume_attachments/b7ce7ed4-ed87-4ee6-b6d8-55adf67c615d" status: 202 len: 0 microversion: 2.1 time: 0.492475 Jul 18 14:21:35.317249 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 134/297] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:21:34 2022] DELETE /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e/os-volume_attachments/b7ce7ed4-ed87-4ee6-b6d8-55adf67c615d => generated 0 bytes in 494 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:21:35.387876 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:35.388925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:35.396132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.397438 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.399177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:35.400072 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:35.588104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:35.596583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-86d1ae6e-e0d3-46c1-8a63-16f3dff537d0 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.212465 Jul 18 14:21:35.599650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 164/298] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:35 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:36.292248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:36.293807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:36.305295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.306163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.307354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.308082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.550369 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:36.560427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:36.561964 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:36.563673 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6d25fbf9-3b91-498e-bcac-62749dfdf4ba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.278549 Jul 18 14:21:36.575086 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 135/299] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:36 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:36.617127 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:36.617767 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:36.625183 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.625956 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.626922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:36.627524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:36.823745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:36.832992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-77d6f720-cac3-44e9-b62e-efdeff073426 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.220349 Jul 18 14:21:36.833719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 165/300] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:36 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:37.583219 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:37.583911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:37.591395 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:37.592052 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:37.592840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:37.593269 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:37.769643 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:37.778059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:37.779598 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:37.780799 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3cf5e4e1-a176-4c7b-ac58-bf00b59ab56d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.201608 Jul 18 14:21:37.781372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 136/301] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:37 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:37.851954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:37.852583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:37.859229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:37.859679 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:37.860721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:37.861163 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:38.010464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:38.018445 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-033a1b68-a749-462e-bf67-2338d77b4422 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.171741 Jul 18 14:21:38.019026 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 166/302] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:37 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:38.388519 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ca28d466-9947-4835-bc58-a5beaef62c06 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Action: 'create', calling method: .version_select at 0x7fb53a516670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-990223256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHncB3w0XQn5MijH8WzOvcNKXONPx4yNXyvaMzcLQkVsiBCAVz1pWH3bx5dTOfyiSwUj0pN5duOdv5qvbxwrxhRWu/oqAxpoXoiKFb3ZkCG2RmYoahLMO8piw6Sf3VnoLw=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:38.404676 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-ca28d466-9947-4835-bc58-a5beaef62c06 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Getting quotas for project af54954fbeeb4772ad57290fceb3b177. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:21:38.409106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-ca28d466-9947-4835-bc58-a5beaef62c06 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Getting quotas for user a9057278ae1c42a5a2802a3be11828df and project af54954fbeeb4772ad57290fceb3b177. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:21:38.435653 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ca28d466-9947-4835-bc58-a5beaef62c06 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.051004 Jul 18 14:21:38.436258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 137/303] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:21:38 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:38.655563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-777253133", "imageRef": "9de0b345-3218-4558-aa55-aa8f9860d64a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-990223256", "networks": [{"uuid": "0d1eb29c-b892-4aa4-adab-3c9da4b5f665"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:38.730897 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] validate_networks() for [('0d1eb29c-b892-4aa4-adab-3c9da4b5f665', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:21:38.801000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:38.801602 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:38.808072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:38.808511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:38.809250 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:38.809693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.038174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.048649 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.050380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.051733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-68721f93-d38e-49f3-846c-4dd6b011ba82 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.256192 Jul 18 14:21:39.052378 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 138/304] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:38 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:39.057361 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:39.058149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:39.069746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:39.070389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.071708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:39.072171 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.298879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:21:39.299542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:21:39.299762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:21:39.300508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:21:39.301106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:21:39.308735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.315342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:39.316154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.317211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:39.317688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:39.321634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-924bdb53-810a-4e79-9c30-78a514c45d3e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.267681 Jul 18 14:21:39.322408 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 139/305] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:39 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:39.339587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Getting quotas for project af54954fbeeb4772ad57290fceb3b177. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:21:39.344413 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Getting quotas for user a9057278ae1c42a5a2802a3be11828df and project af54954fbeeb4772ad57290fceb3b177. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:21:39.357265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:21:39.360417 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9de0b345-3218-4558-aa55-aa8f9860d64a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:21:39.426660 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4fbf22a6-7465-4862-a6ed-7748f31e935c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.789943 Jul 18 14:21:39.432750 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 167/306] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 797 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:21:39.444659 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-47361515-980a-4b1b-a81f-56a99c1df2c6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:39.446047 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-47361515-980a-4b1b-a81f-56a99c1df2c6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:39.510458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-47361515-980a-4b1b-a81f-56a99c1df2c6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:39.519592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-47361515-980a-4b1b-a81f-56a99c1df2c6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1257 microversion: 2.1 time: 0.078976 Jul 18 14:21:39.520228 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 140/307] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:39 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1257 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:39.804855 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0482684-ac5f-4262-b3db-0e207348941c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: .version_select at 0x7fb53a34b820>, body: {"keypair": {"name": "tempest-keypair-1295425227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL2ixgp7MOcEwXJ/+DJI9eVvD43MrB0yMysDiQNc8sCryWWlCzhdD1hWFGcxot1gVH5AVpvqUAjW+ya/Oc1kgGMZq6JLAtdrSfxSoI93UP9Xe3WmB50whNixxcRhAcDJdA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:39.826137 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-e0482684-ac5f-4262-b3db-0e207348941c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:21:39.830414 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-e0482684-ac5f-4262-b3db-0e207348941c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:21:39.862462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e0482684-ac5f-4262-b3db-0e207348941c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.062829 Jul 18 14:21:39.863422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 168/308] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:21:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:40.073990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:40.075381 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:40.085019 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.086625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.087552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.088290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.274315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.286018 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.288123 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.289466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8f99e9a6-972c-4535-a5e7-d500177e6b36 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.221760 Jul 18 14:21:40.290309 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 141/309] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:40 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:40.341078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:40.341778 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:40.348313 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.348776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.349580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.350065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.354605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:40.540321 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:40.541236 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:40.542019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.547346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.547794 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.548593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:40.549023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:40.549848 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-703b436d-97dd-40ba-8ad1-f776e8cb5e7e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.213690 Jul 18 14:21:40.550599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 169/310] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:40 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:40.616099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:40.625196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0983bbd8-af15-4eb0-ab26-e05efbe6a98b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1309 microversion: 2.1 time: 0.089264 Jul 18 14:21:40.625801 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 142/311] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:40 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1309 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:41.308556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:41.309504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:41.321094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.322317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.323945 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.324954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.574180 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:41.576274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:41.582673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:41.614594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.616436 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.618226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.619778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.629060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:41.665610 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:41.678422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-58a24119-a99c-435b-97df-fb65e6a098b0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.369557 Jul 18 14:21:41.679170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 170/312] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:41 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:41.696204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:41.697097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:41.703918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.704447 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:41.705312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:41.705869 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:42.012232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:42.030871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ebec1975-51b9-4e15-a1f1-3794b92a857e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.342921 Jul 18 14:21:42.031756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 171/313] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:41 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:42.041574 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1001456722", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c89027a-566a-4914-8ad9-bb014d7b4afd"}], "security_groups": [{"name": "tempest-securitygroup--549058429"}], "key_name": "tempest-keypair-1295425227", "user_data": "}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:42.064612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:42.091120 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-37ad72d4-4457-4d0b-aafb-bcdbcec385ff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.524920 Jul 18 14:21:42.093619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 143/314] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:41 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:42.696905 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:42.697808 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:42.704475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:42.704909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:42.705717 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:42.706157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:42.860651 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:42.863779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:42.872864 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:42.874413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:42.875634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e01a810f-2c8d-4abb-b493-fb5425fec193 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.182771 Jul 18 14:21:42.876203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 144/315] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:42 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:43.051798 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:43.052460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:43.061136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:43.061599 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:43.062532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:43.062977 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:43.274288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:43.282615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bf5693e8-a154-4e29-b86f-5cba2ff36747 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.235134 Jul 18 14:21:43.283203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 145/316] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:43 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:43.292978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:43.294208 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:43.303652 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:43.304207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:43.305457 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:43.306169 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:43.461220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:43.469954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-efc7b991-8670-41fc-89d2-5e0437ba8037 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.185525 Jul 18 14:21:43.470807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 146/317] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:43 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:43.897472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:43.898474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:43.905082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:43.905524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:43.906348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:43.906776 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:44.098455 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:44.114772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:44.123772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:44.126988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0bf55440-5175-4359-a9c3-c9aae6ad9912 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.234995 Jul 18 14:21:44.127752 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 147/318] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:43 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:44.299974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:44.300640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:44.335770 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:44.336235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:44.337092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:44.337640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:44.512361 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:44.520604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-00c6daca-e88c-4f71-9e78-7a62573c6497 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.224409 Jul 18 14:21:44.521245 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 148/319] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:44 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:44.526027 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:44.526640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:44.534548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:44.534548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:44.534861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:44.535116 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:44.726426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:44.735129 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7f1c8b78-28b0-43c1-8f9a-6ca178bb56cb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.212694 Jul 18 14:21:44.736033 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 149/320] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:44 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:45.151717 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:45.154386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:45.163720 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.164283 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.165608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.166223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.383633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:45.404697 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:45.406926 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:45.408817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7bf7d461-c54a-469f-8557-0d0a8e475c89 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.263791 Jul 18 14:21:45.410071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 150/321] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:45 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:45.428558 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-e785cee3-e4f8-4e8d-8065-caa288ebeb10 req-91bb4240-f67e-4b47-8b93-00fadaf64a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "name": "network-vif-plugged", "status": "completed", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:45.452764 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e785cee3-e4f8-4e8d-8065-caa288ebeb10 req-91bb4240-f67e-4b47-8b93-00fadaf64a26 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.453718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e785cee3-e4f8-4e8d-8065-caa288ebeb10 req-91bb4240-f67e-4b47-8b93-00fadaf64a26 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.467191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-e785cee3-e4f8-4e8d-8065-caa288ebeb10 req-91bb4240-f67e-4b47-8b93-00fadaf64a26 service nova] Creating event network-vif-plugged:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:21:45.472934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-e785cee3-e4f8-4e8d-8065-caa288ebeb10 req-91bb4240-f67e-4b47-8b93-00fadaf64a26 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061581 Jul 18 14:21:45.473525 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 151/322] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:45.539253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:45.540185 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:45.550007 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.550705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.552051 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.552909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.764479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:45.772603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fc441d96-f307-4d1c-bd56-cac022f52ef2 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.237764 Jul 18 14:21:45.773163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 152/323] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:45 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:45.777988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:45.778600 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:45.785092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.785564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:45.786494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:45.786931 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:46.210311 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.218253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3f9cc426-31a3-4e0b-8522-028049749397 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.444062 Jul 18 14:21:46.218852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 153/324] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:45 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:46.448846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:46.449840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:46.456674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:46.457336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:46.458898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:46.459399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:46.676988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.686632 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.688500 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:46.689878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86994ded-f889-4e4c-af5a-3eeab0f84190 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.246185 Jul 18 14:21:46.690864 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 154/325] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:46 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:46.790679 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:46.791218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:46.797966 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:46.798421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:46.799206 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:46.799648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:46.995095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.003025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9be20134-3f13-479b-9a0d-42daccf7892c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.216528 Jul 18 14:21:47.003666 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 155/326] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:46 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:47.236972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:47.236972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:47.247446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:47.247894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:47.248719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:47.249267 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:47.426818 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.434982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f736fdc6-6de8-4de0-8edf-ba6749bb3570 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.202641 Jul 18 14:21:47.435862 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 156/327] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:47 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:47.710430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:47.711087 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:47.719202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:47.719838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:47.720958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:47.721414 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:47.892912 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.902022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.903569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:47.904780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c2149dcd-296d-4439-acdc-756a82436f5b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.199404 Jul 18 14:21:47.905318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 157/328] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:47 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:48.038124 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:48.045293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:48.069404 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:48.070202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:48.071366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:48.071937 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:48.244671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:48.253242 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-800cc97f-174e-43ed-a2ae-bcf184790e02 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.230633 Jul 18 14:21:48.254143 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 158/329] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:48 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:48.468664 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:48.469288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:48.471388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:48.478567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:48.479023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:48.479814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:48.480248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:48.684558 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:48.694386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-00bc9d90-de18-426e-9047-2ce3e7f7d2ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.229694 Jul 18 14:21:48.694947 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 159/330] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:48 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:48.925251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:48.925800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:48.933155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:48.933712 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:48.934487 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:48.934944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.120528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] validate_networks() for [('6c89027a-566a-4914-8ad9-bb014d7b4afd', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:21:49.286223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:49.305366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:49.307039 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:49.308281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-502f9702-6e61-4e72-81a5-c183e52a756e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.387165 Jul 18 14:21:49.311554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 160/331] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:48 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:49.324943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:49.325567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:49.331740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:49.332872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:49.333337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.334479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:49.334997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.523884 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:49.656370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:49.673546 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5321774f-42c7-4baf-becf-fbe8f36a47af tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.362787 Jul 18 14:21:49.674914 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 161/332] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:49 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:49.714208 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:49.716635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:49.723750 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:49.724635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.725597 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:49.726167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.744927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:49.841064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=10 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:49.858251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:21:49.859213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:21:49.859852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:21:49.860628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:21:49.861211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:21:49.875310 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:49.876071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.877094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:49.877881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:49.909903 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:21:49.915712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:21:49.929466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:21:49.929902 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:49.931684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:21:49.937688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-40f7162c-30e6-49fd-82bc-831c6b362649 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.227989 Jul 18 14:21:49.938293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 162/333] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:49 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:49.996315 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e255760b-d443-454a-a15c-7ddbefe8535a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 7.963278 Jul 18 14:21:49.997363 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 172/334] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:21:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 7965 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:21:50.009097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f2266624-0a2d-4141-9cbb-03cdd0eb0ea7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:50.010400 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f2266624-0a2d-4141-9cbb-03cdd0eb0ea7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:50.090586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f2266624-0a2d-4141-9cbb-03cdd0eb0ea7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.098656 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f2266624-0a2d-4141-9cbb-03cdd0eb0ea7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1242 microversion: 2.1 time: 0.094558 Jul 18 14:21:50.107998 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 163/335] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:50 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1242 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:50.343369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:50.344046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:50.353281 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:50.353760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:50.354809 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:50.355244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:50.507635 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.519830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.522421 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.524048 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-92d9e83b-cdfa-48f9-8227-939f4d00427c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.185622 Jul 18 14:21:50.530518 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 173/336] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:50 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:50.692820 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:50.693529 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:50.700583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:50.701038 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:50.701859 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:50.702297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:50.868881 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:50.876821 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f9d318b0-a015-4131-a41b-6217da714267 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.187916 Jul 18 14:21:50.878030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 164/337] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:50 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:50.956785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:50.957498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:50.964258 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:50.964772 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:50.965576 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:50.966051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.119431 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:51.120187 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:51.127112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.128022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.128644 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.129096 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.148820 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.158289 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b2348009-ff3f-4cc3-b6ec-26f4e048c8ed tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.205744 Jul 18 14:21:51.159152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 174/338] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:50 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:51.200235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.208426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f3894c9f-12a1-41ee-b774-f27c589063c3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1246 microversion: 2.1 time: 0.093106 Jul 18 14:21:51.209039 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 165/339] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:51 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:51.543999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:51.544582 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:51.552913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.553884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.554672 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.555111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.717284 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.728813 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.730722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:51.732001 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d887a79d-cf4b-4930-bd63-d9567301b067 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.192548 Jul 18 14:21:51.732707 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 175/340] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:51 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:51.894228 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:51.894867 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:51.902873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.903321 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:51.904096 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:51.904502 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.069476 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.076719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3e5564e9-d26b-49e2-b994-649391369a9f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.186259 Jul 18 14:21:52.099640 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 166/341] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:51 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:52.176695 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:52.177334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:52.184572 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.185023 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.185849 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.186293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.226782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:52.227506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:52.234210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.234770 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.235617 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.236121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.340795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.349380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fed77d59-0048-43a9-8593-ad15f6b7c456 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1246 microversion: 2.1 time: 0.127106 Jul 18 14:21:52.350004 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 167/342] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:52 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1246 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:52.373387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.381555 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8c202d1e-ddd6-45ed-81cb-690d0c925317 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.208741 Jul 18 14:21:52.382145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 176/343] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:52 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:52.751983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:52.752497 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:52.759136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.759590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.760377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:52.760809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:52.921903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.931523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.933126 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:52.934219 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a5ca910e-7a06-424c-aaa6-7a1478864e97 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.186276 Jul 18 14:21:52.934786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 168/344] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:52 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:53.094147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:53.094760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:53.102158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.102605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.103393 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.103830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.243686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:53.253713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f3b6000d-ef3c-4baa-83ee-7aab752a7a59 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.163289 Jul 18 14:21:53.254464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 177/345] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:53 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:53.368471 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:53.369033 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:53.377062 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.377515 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.378328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.378786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.399743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:53.400361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:53.407071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.407524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.408307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.408745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.454982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:53.468856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-da686479-1530-4b12-ad78-dd3403e18b5f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1246 microversion: 2.1 time: 0.105418 Jul 18 14:21:53.471178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 169/346] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:53 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1246 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:53.572931 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:53.581003 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3fd7fc0-ec5d-4b90-ba69-c6dab5198800 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.185335 Jul 18 14:21:53.581578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 178/347] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:53 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:53.955191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:53.955878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:53.963366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.963875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:53.965588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:53.966622 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.212476 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.221634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.223230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.224572 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4e5436d6-9c05-4756-8f13-6a2aa54e3a10 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.274291 Jul 18 14:21:54.225332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 170/348] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:53 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:54.275801 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:54.276412 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:54.286452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.287195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.288642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.289273 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.499212 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:54.500037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:54.510811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.511706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.512725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.513532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.531758 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.545488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c793bbcc-193f-488c-bb52-99ee5ee14c46 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.273851 Jul 18 14:21:54.546176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 179/349] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:54 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:54.598972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:54.599639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:54.606366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.607106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.608428 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.609040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.674606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.685689 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-840df7c6-57ef-4d95-acbb-a1e34eeded83 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1238 microversion: 2.1 time: 0.193683 Jul 18 14:21:54.686570 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 171/350] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:54 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1238 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:54.841955 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:54.850376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-05bbe3a3-8399-4ac9-951e-b02dedcceba7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.255427 Jul 18 14:21:54.851159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 180/351] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:54 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:54.924546 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-ee2b1122-bfe2-4386-a079-4ba3c2a3771a req-43a308fe-23d6-4509-bdcb-a021679b3701 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:54.936013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-ee2b1122-bfe2-4386-a079-4ba3c2a3771a req-43a308fe-23d6-4509-bdcb-a021679b3701 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:54.939324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-ee2b1122-bfe2-4386-a079-4ba3c2a3771a req-43a308fe-23d6-4509-bdcb-a021679b3701 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:54.953870 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-ee2b1122-bfe2-4386-a079-4ba3c2a3771a req-43a308fe-23d6-4509-bdcb-a021679b3701 service nova] Creating event network-changed:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:21:54.961214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-ee2b1122-bfe2-4386-a079-4ba3c2a3771a req-43a308fe-23d6-4509-bdcb-a021679b3701 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043959 Jul 18 14:21:54.962240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 172/352] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:21:55.244283 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:55.244901 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:55.251375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.251779 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.252533 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.252989 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.416969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.426060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.427629 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.429224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3f54598d-e9b2-49c3-84c4-94ac65175c5c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.189231 Jul 18 14:21:55.429817 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 181/353] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:55 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:55.564700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:55.565299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:55.573015 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.573469 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.574309 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.575188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.702657 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:55.703283 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:55.710043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.710799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.711600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.712119 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.735537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.749628 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2796ab6c-d7fd-423b-87b6-afef2d9afd04 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.189333 Jul 18 14:21:55.750467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 173/354] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:55 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:55.758911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8c85f308-d534-4553-b5ef-64d0d57ff082 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:21:55.774263 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8c85f308-d534-4553-b5ef-64d0d57ff082 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.774986 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8c85f308-d534-4553-b5ef-64d0d57ff082 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.782701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:55.790787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c9bb08f9-cfb4-46d4-854e-e92af8a83ab3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1294 microversion: 2.1 time: 0.092160 Jul 18 14:21:55.791365 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 182/355] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:55 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:55.839908 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8c85f308-d534-4553-b5ef-64d0d57ff082 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Going to try to stop instance {{(pid=117766) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 14:21:55.868960 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:55.869769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:55.877870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.878308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.879288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.879908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.903162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8c85f308-d534-4553-b5ef-64d0d57ff082 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action" status: 202 len: 0 microversion: 2.1 time: 0.151248 Jul 18 14:21:55.904083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 174/356] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:21:55 2022] POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:21:55.914275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:55.915149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:55.922318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.922790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:55.923568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:55.923995 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.091650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:56.106842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3bb7e2d8-84f4-46c0-bdf0-a2e823cac5f1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.241925 Jul 18 14:21:56.114196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:56.114902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 183/357] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:55 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:56.125089 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1907cee5-0c92-46db-84af-6738fede4cd0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.216056 Jul 18 14:21:56.125927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 175/358] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:55 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:56.449073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:56.449835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:56.458625 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.459806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.460940 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.462040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.628821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:56.638179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:56.639735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:56.640952 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5dedc65b-f639-461a-b863-becba6c45c62 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1745 microversion: 2.20 time: 0.196260 Jul 18 14:21:56.641526 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 184/359] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:56 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1745 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:21:56.768431 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:56.768951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:56.776555 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.777294 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.777803 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.778243 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.808410 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:56.809014 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:56.816045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.816458 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.817213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:56.817645 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:56.958161 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:56.967735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d28dfe69-7892-496e-a8f6-b9654b54627f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1294 microversion: 2.1 time: 0.163039 Jul 18 14:21:56.968373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 185/360] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:56 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1294 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:57.122573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:57.135204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:57.135837 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:57.137927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a2ee0d8b-3bdd-4fe6-9563-a9d9cf827003 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.373341 Jul 18 14:21:57.144472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:57.144931 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:57.145748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:57.146190 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:57.146829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 176/361] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:56 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:57.156228 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:57.156970 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:57.166757 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:57.167216 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:57.168009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:57.168446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:57.168990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:58.063469 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.099024 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.109939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3aa9ea1d-f21f-4c82-bd8a-8aa877b5db90 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.981178 Jul 18 14:21:58.111064 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a9f21f7a-1d96-4717-b072-a8669781ed14 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.962306 Jul 18 14:21:58.111898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 177/362] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:57 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:58.125043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 186/363] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:57 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:58.133344 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:58.134197 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:58.144793 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.146909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.149380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.150246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.154140 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:58.160030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:58.189782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.192371 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.195844 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.196307 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.306914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.331909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7fedf1dc-1556-4273-bcb1-911e1b4a3466 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1300 microversion: 2.1 time: 0.204363 Jul 18 14:21:58.358831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 187/364] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:58 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1300 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:58.371131 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:58.372034 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:58.382639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.382639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.382639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.382639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.604982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.626128 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.636186 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.642709 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c7318321-2082-4438-b92d-b7ce44ae8d12 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.510540 Jul 18 14:21:58.645634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 178/365] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:58 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:21:58.654584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:58.656735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:58.672716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.675611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.677782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.678832 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.710035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:58.713969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:58.726176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d4d49513-bef8-4bfd-b874-ae9f8fafb9ea tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.363989 Jul 18 14:21:58.731681 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:21:58.738505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 188/366] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:58 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:58.875767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6c6371a6-63ed-4dcb-ab5d-2ce38dd01ac0 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 204 len: 0 microversion: 2.1 time: 0.227745 Jul 18 14:21:58.876289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 179/367] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:21:58 2022] DELETE /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:21:58.891480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:58.892512 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:58.900199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.901064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:58.904486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:58.905852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.130989 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:59.132563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:59.141348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.142178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.143213 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.143876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.169265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.196285 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-09e31249-85d9-45b9-8c5b-1f1746c8ba6b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1513 microversion: 2.1 time: 0.313222 Jul 18 14:21:59.202837 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 189/368] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:58 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1513 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:59.208789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:59.215872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:59.230682 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.232108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.236401 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.237410 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.651848 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.668691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d88b50d0-bfae-40e3-8330-78af307860b0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.542350 Jul 18 14:21:59.671618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 180/369] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:59 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:21:59.676709 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:59.677716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:59.697372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.697903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.698691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.699136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.732471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.762334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-18b848ef-778a-4430-837d-d8fc28861a07 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.557369 Jul 18 14:21:59.763728 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 190/370] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:59 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:59.781000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:59.787697 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:59.791374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:59.795508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.795827 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.796510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.796953 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.872380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:21:59.885550 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fd1f3b51-0deb-4e20-9819-ab569c5d93ff tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1300 microversion: 2.1 time: 0.212693 Jul 18 14:21:59.886207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 181/371] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:59 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1300 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:21:59.901102 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:21:59.901772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:21:59.902762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:21:59.909500 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.910028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.910906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:21:59.911364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:21:59.925203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:00.095680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:00.549793 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.561321 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.574773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-38cbd164-a65a-4d75-a43d-7eb98b25516a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.677840 Jul 18 14:22:00.577868 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.578111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.579246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3d70dd5a-443c-4d20-be19-b8b98e72511b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.811764 Jul 18 14:22:00.579749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 182/372] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:21:59 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:00.585081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:00.587301 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 191/373] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:21:59 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:00.591766 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:00.599724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.600818 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.602073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.602930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.702003 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:00.702536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:00.721377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.721905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.722751 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.742935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.914226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:00.926719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-60127794-3012-4eff-8283-770cc2a8c078 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1513 microversion: 2.1 time: 0.345015 Jul 18 14:22:00.927688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 183/374] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:00 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1513 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:00.934965 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:00.944652 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:00.967623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.968407 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:00.969626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:00.970089 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.022297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.034224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e3ce814b-f22d-4a1d-ba26-c2f16d47a0c6 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.349232 Jul 18 14:22:01.045261 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 192/375] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:00 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:01.051369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:01.052279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:01.061330 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.061762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.062828 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.063270 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.307140 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.325226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ad584759-ef71-4b2a-9684-b01c1daa57f6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.394902 Jul 18 14:22:01.326624 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.327727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 184/376] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:00 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:01.357873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9d28ef5e-fb6f-4bd3-9b3a-0a48c63bd770 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.300865 Jul 18 14:22:01.357873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 193/377] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:01 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:01.606959 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:01.608760 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:01.626346 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:01.630825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:01.649712 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.650568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.652562 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.653760 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.663231 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.663557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.664502 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:01.666398 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:01.980748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:01.996908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:02.012946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:02.017237 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:02.030456 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-17a48a58-fafe-4c5e-9520-8e4b20ba5980 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.409627 Jul 18 14:22:02.032877 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 194/378] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:01 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:22:02.041853 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bf59ab72-8824-4fff-a5cd-e42e8d009016 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.429402 Jul 18 14:22:02.042150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 185/379] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:01 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:02.051309 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:02.052767 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:02.087913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:02.087913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:02.109533 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.110696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.120375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.121849 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.129327 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.130234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.131576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.143825 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.542634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:02.573774 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-47142ed9-9495-4194-8d44-bc2cd2a61a0b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.509957 Jul 18 14:22:02.573774 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 186/380] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:02 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:02.573774 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:02.573774 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:02.583092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.585411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.586664 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.586963 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.858492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:02.892182 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3fcf68be-4354-431c-80f3-89b8267e6841 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1513 microversion: 2.1 time: 0.856961 Jul 18 14:22:02.906781 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 195/381] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:02 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1513 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:02.928435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:02.938940 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:02.958725 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.960339 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:02.966445 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:02.969859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.078223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:03.114519 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-77abcd73-43c1-4728-8521-55c3dad58815 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1502 microversion: 2.1 time: 0.545930 Jul 18 14:22:03.116516 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 187/382] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:02 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1502 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:03.122514 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:03.123543 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:03.135735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.137909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.140592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.141229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.658780 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:03.668106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b23a8468-f89e-46ea-a9ae-9cfeb93da2da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.759673 Jul 18 14:22:03.689970 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 196/383] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:02 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:03.698788 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:03.708779 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:03.732377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.733648 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.735429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.745408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.866031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:03.902256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:03.907435 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:03.910789 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9ae631f9-3c9c-44c4-9c9c-9dc092b2a596 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.792583 Jul 18 14:22:03.915906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 188/384] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:03 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:03.927085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d26d9a07-5a7c-45f5-a223-0bc4294d142d"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:03.933475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:03.952209 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.954529 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:03.957318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:03.958510 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.010257 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] HTTP exception thrown: Cannot 'attach_volume' instance fedbc653-17b5-4127-8c87-b446551d81dc while it is in vm_state rescued Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Request method failure captured: Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/os-volume_attachments HTTP/1.1 Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 74 Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvqT-vMuaaccIbC9_d9fh0zgzEeFdGY0u6NXMWx0l2Uebt77StaetXx51TnLsBNIos7d85_Y2rC9J6HE5xJO8mTOeTP_8mJRjF9v0cXZCZ7nGdI4ff8IHrAZ_3NhVBwts4qNbPleLh4-G9N74qPZe5NrSSEx7tK7W0liRixYb4CLsY Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:22:04.014113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_38cf167c2fc74ac09d6f6d6f81829cda", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 8a45cafadb824e08bd9e86fd0d5c4c71 Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {"volumeAttachment": {"volumeId": "d26d9a07-5a7c-45f5-a223-0bc4294d142d"}} Jul 18 14:22:04.016735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Cannot 'attach_volume' instance fedbc653-17b5-4127-8c87-b446551d81dc while it is in vm_state rescued Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'server_id': 'fedbc653-17b5-4127-8c87-b446551d81dc', 'body': {'volumeAttachment': {'volumeId': 'd26d9a07-5a7c-45f5-a223-0bc4294d142d'}}} Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fedbc653-17b5-4127-8c87-b446551d81dc in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:22:04.018248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance fedbc653-17b5-4127-8c87-b446551d81dc while it is in vm_state rescued Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:22:04.020535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:22:04.022797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:22:04.022797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:22:04.022797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance fedbc653-17b5-4127-8c87-b446551d81dc while it is in vm_state rescued Jul 18 14:22:04.022797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:22:04.025791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Returning 409 to user: Cannot 'attach_volume' instance fedbc653-17b5-4127-8c87-b446551d81dc while it is in vm_state rescued {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:22:04.027779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c7ebb6e2-ada2-4faa-9f30-a16a2391fc2d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.109215 Jul 18 14:22:04.034474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 189/385] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:22:03 2022] POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/os-volume_attachments => generated 152 bytes in 112 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 14:22:04.047768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:04.049398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:04.063968 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.065483 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.067828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.070521 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.440518 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:04.454656 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-92941bf6-2afc-4098-8c08-75a5951aa34f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.762976 Jul 18 14:22:04.458533 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 197/386] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:03 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:04.464869 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-a9151ae8-0f0f-45bc-8155-e9603fb761fe req-39982faa-1e98-443d-a04e-186b8ac91b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "name": "network-vif-plugged", "status": "completed", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:04.475174 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a9151ae8-0f0f-45bc-8155-e9603fb761fe req-39982faa-1e98-443d-a04e-186b8ac91b2d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.476693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a9151ae8-0f0f-45bc-8155-e9603fb761fe req-39982faa-1e98-443d-a04e-186b8ac91b2d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.494165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-a9151ae8-0f0f-45bc-8155-e9603fb761fe req-39982faa-1e98-443d-a04e-186b8ac91b2d service nova] Creating event network-vif-plugged:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:22:04.501836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-a9151ae8-0f0f-45bc-8155-e9603fb761fe req-39982faa-1e98-443d-a04e-186b8ac91b2d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040547 Jul 18 14:22:04.503009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:04.508875 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 198/387] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:04.516766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:04.521869 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:04.524348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-79365aaf-22f9-4fc8-8893-a3a2fbb08189 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.483554 Jul 18 14:22:04.525319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 190/388] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:04 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:04.540153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:04.543180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.544620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:04.551505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.553884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.554820 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.566197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.567073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.570132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.571530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.643800 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.644332 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.644805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lazy-loading 'fault' on Instance uuid c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:22:04.744844 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b25d2b07-4b7d-4d1f-9f13-1132d18228c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/action" status: 202 len: 0 microversion: 2.1 time: 0.217851 Jul 18 14:22:04.746540 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 191/389] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:22:04 2022] POST /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:22:04.759747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-0012264b-335e-44c6-9dc1-af2bc020d80c req-22f2267d-92d3-4d8c-9ab3-be3490801660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e", "name": "network-vif-deleted", "tag": "55d29a21-a693-4955-b103-cbbaeaccf89d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:04.774689 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0012264b-335e-44c6-9dc1-af2bc020d80c req-22f2267d-92d3-4d8c-9ab3-be3490801660 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.775302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-0012264b-335e-44c6-9dc1-af2bc020d80c req-22f2267d-92d3-4d8c-9ab3-be3490801660 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.820246 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-0012264b-335e-44c6-9dc1-af2bc020d80c req-22f2267d-92d3-4d8c-9ab3-be3490801660 service nova] Creating event network-vif-deleted:55d29a21-a693-4955-b103-cbbaeaccf89d for instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e on hv-cinder-79760 Jul 18 14:22:04.835341 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-0012264b-335e-44c6-9dc1-af2bc020d80c req-22f2267d-92d3-4d8c-9ab3-be3490801660 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084429 Jul 18 14:22:04.838933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 192/390] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:04.860631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:04.865104 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:04.880851 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:04.888963 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ea6f7138-b31f-44b8-a980-18e08ef990cb tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 200 len: 1308 microversion: 2.1 time: 0.377942 Jul 18 14:22:04.899403 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.899403 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.899403 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.899403 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.900199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 199/391] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:04 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:04.910614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:04.920013 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:04.927132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.927981 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:04.929112 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:04.932446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.432325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:05.446885 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-afa67e64-d5c3-4d14-8921-6d412872ce8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.605557 Jul 18 14:22:05.448195 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 193/392] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:04 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:05.470086 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:05.471543 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:05.497234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.498512 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.500279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.501615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.519423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:05.533135 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d47451fe-7232-40f8-90d1-da31c1921edd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.631543 Jul 18 14:22:05.535194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 200/393] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:04 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:05.544629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:05.550879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-9baae2a9-f91a-41ce-9a9a-d5ddd9d5dabe req-4fa2800e-7ef0-4595-a1ad-8a265616ef0f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2", "tag": "45c0aed7-05fa-4930-9aec-cbafd5909f17"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:05.566884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-9baae2a9-f91a-41ce-9a9a-d5ddd9d5dabe req-4fa2800e-7ef0-4595-a1ad-8a265616ef0f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.567691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-9baae2a9-f91a-41ce-9a9a-d5ddd9d5dabe req-4fa2800e-7ef0-4595-a1ad-8a265616ef0f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.582203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-9baae2a9-f91a-41ce-9a9a-d5ddd9d5dabe req-4fa2800e-7ef0-4595-a1ad-8a265616ef0f service nova] Creating event network-changed:45c0aed7-05fa-4930-9aec-cbafd5909f17 for instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 on hv-cinder-79760 Jul 18 14:22:05.589813 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-9baae2a9-f91a-41ce-9a9a-d5ddd9d5dabe req-4fa2800e-7ef0-4595-a1ad-8a265616ef0f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042040 Jul 18 14:22:05.591886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 201/394] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:05.604507 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:05.605235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:05.621706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.622748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.624374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.625390 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.847288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:05.863940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:05.867488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:05.870241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bb6b323b-405a-4fb6-8549-75ec8f2bdc05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.419656 Jul 18 14:22:05.873242 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 194/395] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:05 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:05.882357 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:05.898625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:05.910873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.911321 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.912289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.913064 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.963768 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:05.975847 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-34b7adfc-ac4d-41f3-834e-d151828c619b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.381610 Jul 18 14:22:05.976926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 202/396] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:05 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:05.981912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:05.982890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:05.991701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.992457 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:05.993568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:05.994179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.011211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] HTTP exception thrown: Instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e could not be found. Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Request method failure captured: Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e HTTP/1.1 Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wwc4-qReyN6QwnJLeKc6Lau0wUJ6D5ePjSyZcwouj_2upvZirtYwxcUJnScYa9z0DEjNRnwgu2o_EvF1v3J2xIVb2qD1fksyrhldKGQV9WlSOEC7db2pl_T42XsUC5fKOVIxrYqfnKqqnIB6QftfMvTUeV_lWivTv1uLt9lJNIh3wE Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 2bba9fd8306e43b6b1cbc2dd4a789736 Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotTestJSON-171614860 Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:22:06.013407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/2bba9fd8306e43b6b1cbc2dd4a789736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/2bba9fd8306e43b6b1cbc2dd4a789736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/2bba9fd8306e43b6b1cbc2dd4a789736"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_2bba9fd8306e43b6b1cbc2dd4a789736", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotTestJSON-171614860 Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 2bba9fd8306e43b6b1cbc2dd4a789736 Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-171614860 Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotTestJSON-171614860-project Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 2865db5146784ee188001703d85d8809 Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotTestJSON-171614860-project Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e could not be found. Jul 18 14:22:06.014979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e'} Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e could not be found. Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:22:06.015896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e could not be found. Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e could not be found. Jul 18 14:22:06.017262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:22:06.019846 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Returning 404 to user: Instance c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:22:06.021000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-40dc7616-27a0-4e3c-b247-3f9051497608 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e" status: 404 len: 111 microversion: 2.1 time: 0.042865 Jul 18 14:22:06.026083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 203/397] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:05 2022] GET /compute/v2.1/servers/c8e05c25-2b9e-40d7-96b7-fcdd8d1aea0e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:22:06.163313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:06.172939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8b8f9797-9cfa-4901-bedf-c9fe07d06823 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.297817 Jul 18 14:22:06.173721 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 195/398] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:05 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:06.465112 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:06.465799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:06.473583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:06.474375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.475477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:06.476073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.552988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:06.553633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:06.560303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:06.561481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.562541 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:06.563265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.722210 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:06.730482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:06.745625 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-90cf73ac-9ceb-45ba-b0f9-3080b8df98f0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.284249 Jul 18 14:22:06.763339 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 204/399] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:06 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:06.766364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:06.774908 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9d054321-339a-44ed-a1f5-68f86b3be82f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.226369 Jul 18 14:22:06.775697 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 196/400] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:06 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:06.902491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:06.903443 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:06.912085 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:06.912894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.913902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:06.914320 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:06.994492 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:06.995123 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:07.002124 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.002584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.003389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.003827 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.121784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:07.153211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:07.155099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:07.156561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-28ec462e-9278-4f47-ad14-1186ce6cd3e6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.259039 Jul 18 14:22:07.157146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 205/401] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:06 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:07.194431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:07.198532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:07.202935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.203628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.204594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.205125 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.213211 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:07.224701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-557ba63a-6fa1-4256-85e4-b39d68344c33 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.234355 Jul 18 14:22:07.225611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 197/402] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:06 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:07.385733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:07.394906 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3f32e648-1d82-439c-bdde-72c0e310e0bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.205328 Jul 18 14:22:07.395492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 206/403] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:07 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:07.777269 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:07.778984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:07.794303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.795088 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.795943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.796224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:07.796789 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.797076 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:07.807334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.807916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:07.808874 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:07.809328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.017762 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.028595 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c3490bb0-2bb7-4aee-bd9d-3a2592142852 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.256158 Jul 18 14:22:08.029965 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 198/404] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:07 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:08.035391 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.043698 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3ffb5752-f313-40bb-902c-c4c5c3d4cfc7 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.254697 Jul 18 14:22:08.044303 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 207/405] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:07 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:08.176935 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:08.177869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:08.185837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:08.186610 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.187618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:08.188229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.243103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:08.243720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:08.265579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:08.266236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.267287 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:08.267924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.691252 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.700725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.703381 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.705806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5354c653-65e1-48b5-8f4f-3a17738af62e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.532574 Jul 18 14:22:08.717925 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 199/406] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:08 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:08.723315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:08.724247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:08.731649 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:08.732235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.733123 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:08.733671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:08.744300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.752577 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4fd609e0-8107-4d20-8845-8c48f78c80fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.514661 Jul 18 14:22:08.753438 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 208/407] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:08 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:08.885606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:08.898855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-08bfc220-5321-4cdd-b85f-91ae9ce0ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.179178 Jul 18 14:22:08.899434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 200/408] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:08 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:09.047957 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:09.048565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:09.056355 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.064330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:09.065107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.065637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:09.066143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.066620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.078135 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.079567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.080483 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.081278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.328931 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:09.348091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4af2bda2-2380-4aa7-a4ef-8ce7b5017c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.304352 Jul 18 14:22:09.350446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 209/409] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:09 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:09.368808 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:09.388843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f9d307dd-56aa-4997-a7e5-8aaadcffb9b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.330220 Jul 18 14:22:09.389517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 201/410] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:09 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:09.729021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:09.730636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:09.743277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.743732 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.744592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.745034 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.770706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:09.772624 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:09.782880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.783811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.784905 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:09.785592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:09.997098 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.019389 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.020922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.023045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0eeda318-673e-4cd7-a3f6-02cfb788e1ce tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.301773 Jul 18 14:22:10.028578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.030298 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 210/411] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:09 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:10.035388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:10.035924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:10.047453 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0710b709-5764-4157-bdd6-e5f034d94a38 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.280720 Jul 18 14:22:10.057848 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 202/412] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:09 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:10.062917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.063584 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.064141 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.064582 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.226933 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.236058 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d2c0c18a-a5b4-4075-b933-dface78264bc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.204491 Jul 18 14:22:10.236860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 211/413] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:10 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:10.379450 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:10.380159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:10.389312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.391131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.393254 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.393851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.406345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:10.407107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:10.417530 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.418189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.419204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:10.419963 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:10.693789 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.696701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:10.706929 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b7bdeebe-efa2-4361-9224-60a91843d9cd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.303850 Jul 18 14:22:10.710165 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-31a05306-6fca-47c1-978f-536f47faeada tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.345798 Jul 18 14:22:10.711864 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 212/415] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:10 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:10.721902 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 203/415] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:10 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:11.041834 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:11.042614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:11.049353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.050157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.050603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.051080 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.064819 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:11.065531 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:11.082025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.082025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.082025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.082025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.289807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.292824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.297739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8cdaf00c-ee35-42fe-a9b7-f560164f91c7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.236963 Jul 18 14:22:11.298341 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 204/416] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:11 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:11.302103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.302767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:11.303426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:11.303905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.305375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dc5d0a88-bd59-474d-8b1f-d41a35903446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.268795 Jul 18 14:22:11.305552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:11.306040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 213/417] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:11 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:11.313911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.314426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.315355 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.315898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.454781 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.464440 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e7d700e7-45f9-4f26-8810-3bd6590408c1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.165046 Jul 18 14:22:11.465307 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 205/418] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:11 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:11.727980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:11.728204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:11.728499 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:11.728658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:11.735197 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.735650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.736413 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.736849 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.742222 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.742677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.743472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:11.743906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:11.955669 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.961473 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:11.963642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b4826f7e-0919-460e-aba7-4c78110cf3b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.240014 Jul 18 14:22:11.964244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 214/419] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:11 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:11.977037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2e8533c4-bc17-4db5-a96b-0af50471706d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.252597 Jul 18 14:22:11.977677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 206/420] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:11 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:12.330444 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:12.331035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:12.335381 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:12.336005 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:12.338776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.339242 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.340038 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.340475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.342506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.343442 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.343854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.344499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.558340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:12.561863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:12.567103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3b324aac-6ccd-43a8-8852-f6be29daafb3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.240243 Jul 18 14:22:12.567879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 215/421] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:12 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:12.574039 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:12.574710 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:12.575374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:12.577091 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:12.578638 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3ba747e8-3317-4a0f-8c97-61e5467a9f61 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.247652 Jul 18 14:22:12.579281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 207/422] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:12 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:12.582152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.582720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.583508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.584623 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.733064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:12.743118 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ca614bd3-4ade-4ba4-bfde-510bd1bdd4b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.173064 Jul 18 14:22:12.743669 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 216/423] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:12 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:12.982011 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:12.982587 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:12.989649 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.990263 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:12.991065 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:12.991726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.004865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:13.005719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:13.014870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.016510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.017511 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.017954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.235861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.250724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4e6244c1-248a-4714-af1f-62b2bfaebd2d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.272577 Jul 18 14:22:13.251755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 208/424] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:12 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:13.290425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.298186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8fb1339e-f942-4b2b-af63-ef1539a39c87 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.297246 Jul 18 14:22:13.298766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 217/425] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:12 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:13.585490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:13.586344 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:13.593392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.593939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.594746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.595214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.599360 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:13.600122 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:13.607063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.607520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.608402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.608785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.936044 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.946196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6d5bdbd1-2d45-4ed8-b257-68fd8a185c4f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1357 microversion: 2.1 time: 0.364735 Jul 18 14:22:13.946897 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 209/426] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:13 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1357 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:13.965467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:13.966812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:13.974049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.978885 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.979738 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.980756 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:13.981389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:13.983509 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.985310 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:13.986597 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fe8fb564-d9f1-4da5-be4d-b646a489768a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1740 microversion: 2.20 time: 0.391341 Jul 18 14:22:13.987368 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 218/427] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:13 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1740 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:14.212802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:14.222102 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33ae76e8-e310-45e0-b916-c37f359d725b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.264694 Jul 18 14:22:14.222943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 210/428] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:13 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:14.274261 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:14.274873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:14.281847 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.282263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.283991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.283991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.316193 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:14.317198 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:14.326434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.327256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.327754 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.328244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.347653 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:14.511334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:14.520004 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0da11aa2-ca00-4b2d-89ff-4cfdf9ccee6e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.250049 Jul 18 14:22:14.529583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 219/429] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:14 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:14.532509 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:14.540520 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-93414cce-204a-4cff-aebc-054ff82e4263 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.228198 Jul 18 14:22:14.541093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 211/430] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:14 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:14.963573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:14.964209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:14.970932 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.971389 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:14.972160 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:14.972573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.005554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.006342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:15.013832 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.014276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.015070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.015504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.174427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.183072 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-75912158-5b3f-42fc-af77-11eda1f56be7 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1548 microversion: 2.1 time: 0.223430 Jul 18 14:22:15.183649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 220/431] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:14 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1548 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:15.199846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.200644 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.201252 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:15.207709 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.208165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.208287 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.209009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.209565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.209931 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.211095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-90fc06ef-573f-41ff-afce-a2b854b317db tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.209586 Jul 18 14:22:15.211680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 212/432] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:22:15.228534 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:15.241217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.241958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:15.248158 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.248735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.249566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.250097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.418415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.426921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e27b6eb6-cf25-4cb6-b14f-1ce7f2e9663c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1548 microversion: 2.1 time: 0.230121 Jul 18 14:22:15.438500 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 221/433] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1548 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:15.445648 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.449903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.450217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.450977 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Searching by: {'deleted': False, 'project_id': 'af54954fbeeb4772ad57290fceb3b177'} {{(pid=117767) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 18 14:22:15.458865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.459055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5cbc4a3d-1272-493e-8066-ea24f4dadc77 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.222383 Jul 18 14:22:15.459293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.459641 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 213/434] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:15.460340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.460781 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.541139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.541970 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:15.548227 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.548995 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.549901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.550435 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.559405 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.multi_cell_list [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117767) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 18 14:22:15.663709 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57a85bda-3f0a-4c65-9087-8a5ee267ca65 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.224049 Jul 18 14:22:15.664497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 222/435] 10.222.0.71 () {58 vars in 1124 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers => generated 342 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:15.673038 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.673895 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:15.680643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.681099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.682199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.682634 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.713085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.721418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86440224-0ae3-4908-ad4e-97dbf310253b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.184882 Jul 18 14:22:15.722625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 214/436] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:15.727373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:15.728066 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:15.738636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.742148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.742972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:15.743413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:15.882279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.897229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bf7e47d8-b243-411b-a437-aa7003c1fc1b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.229169 Jul 18 14:22:15.898354 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 223/437] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:15.919733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:15.928130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-76fb36f7-6196-4136-a8b9-c014dbc1db47 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1548 microversion: 2.1 time: 0.204268 Jul 18 14:22:15.928993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 215/438] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:15 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:16.232453 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:16.234020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:16.245874 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.247282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.249247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.250472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.448160 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:16.457570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:16.459493 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:16.460602 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e700501d-b9aa-4b30-b8b0-30ea054d129f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.234405 Jul 18 14:22:16.461158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 224/439] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:16 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:16.477304 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:16.477967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:16.484672 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.485132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.485953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.486725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.644121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:16.654518 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-16a66a11-bb32-456a-9272-5c36614dff83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.181412 Jul 18 14:22:16.655101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 216/440] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:16 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:16.739977 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:16.740861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:16.747906 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.748348 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.749159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.749779 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.901985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:16.910797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-813bf878-d530-4eed-b6c5-dbcb5b287641 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.175166 Jul 18 14:22:16.911565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 225/441] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:16 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:16.914328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:16.915118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:16.921525 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.922005 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:16.922792 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:16.923263 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:17.064522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:17.073035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8c93f1b4-3f16-47e0-9867-adeb6311d782 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.162509 Jul 18 14:22:17.074060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 217/442] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:16 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:17.481549 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:17.482682 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:17.490597 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:17.491533 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:17.492409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:17.492908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:17.633696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:17.643417 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:17.645791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:17.647524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b5188466-9c9c-486b-9f01-53cae8e77696 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.171901 Jul 18 14:22:17.648080 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 226/443] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:17 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:17.673815 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:17.674398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:17.681340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:17.681836 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:17.682590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:17.683047 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:17.828044 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:17.840002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8989a18f-1bb4-4238-9fb2-c918213005fe tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.170109 Jul 18 14:22:17.840797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 218/444] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:17 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:17.928599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:17.929090 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:17.935919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:17.936383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:17.937167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:17.937595 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.073493 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:18.082896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bc41042f-d260-4ca9-86d3-a14a86446ffa tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.158058 Jul 18 14:22:18.083617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 227/445] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:17 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:18.092369 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:18.093270 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:18.100925 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.101426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.102160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.102658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.255059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:18.262942 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-368f9425-e775-4ba2-9eed-9382efeb36cc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.175235 Jul 18 14:22:18.263616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 219/446] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:18 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:18.396380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-c9423e7b-7bfe-4870-8c19-b9183136d0ae req-b6d475aa-c893-4be8-bfcc-512c1d0409cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "name": "network-vif-unplugged", "status": "completed", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:18.407405 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c9423e7b-7bfe-4870-8c19-b9183136d0ae req-b6d475aa-c893-4be8-bfcc-512c1d0409cf service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.407853 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c9423e7b-7bfe-4870-8c19-b9183136d0ae req-b6d475aa-c893-4be8-bfcc-512c1d0409cf service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.423001 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-c9423e7b-7bfe-4870-8c19-b9183136d0ae req-b6d475aa-c893-4be8-bfcc-512c1d0409cf service nova] Creating event network-vif-unplugged:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:22:18.431099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-c9423e7b-7bfe-4870-8c19-b9183136d0ae req-b6d475aa-c893-4be8-bfcc-512c1d0409cf service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041646 Jul 18 14:22:18.432554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 228/447] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:18.671489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:18.672009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:18.679670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.680534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.680807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.681240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.820737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:18.829093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:18.830625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:18.831778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fccc55a2-a158-4440-b124-93ecfd4423ca tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.164554 Jul 18 14:22:18.832356 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 220/448] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:18 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:18.861727 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:18.862430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:18.869927 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.870376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:18.871177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:18.871607 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:19.018292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:19.028573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-06da2329-e046-418d-8bd6-9694e7c1769d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.171705 Jul 18 14:22:19.029149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 229/449] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:18 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:19.102683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:19.103324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:19.110060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:19.110511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:19.111288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:19.111718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:19.251273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:19.259498 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0723a667-e09c-4c12-93f3-50b65a724feb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.160971 Jul 18 14:22:19.260050 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 221/450] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:19 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:19.280520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:19.281044 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:19.287639 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:19.288093 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:19.288863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:19.289297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:19.429979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:19.438617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e33cd5db-7d30-4a04-8523-902c6b202906 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1510 microversion: 2.1 time: 0.161495 Jul 18 14:22:19.439708 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 230/451] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:19 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1510 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:19.850620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:19.851191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:19.858384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:19.858839 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:19.859633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:19.860093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:20.001079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:20.010115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:20.011647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:20.012838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-639fbffe-64fa-4872-bf72-1f418a0fd16f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.166605 Jul 18 14:22:20.013397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 222/452] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:19 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:20.046591 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:20.047180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:20.054902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:20.055360 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:20.056143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:20.056582 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:20.214876 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:20.226564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b020b3e4-83f6-47d5-981f-7987cef91569 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.183960 Jul 18 14:22:20.227272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 231/453] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:20 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:20.277410 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:20.278205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:20.285842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:20.286420 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:20.287636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:20.287863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:20.301086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-299512213", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "networks": [{"uuid": "72c5cb8a-49de-4a64-927c-6cce6f71eb64"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:20.367486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] validate_networks() for [('72c5cb8a-49de-4a64-927c-6cce6f71eb64', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:22:20.609704 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:20.627029 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-11366554-cdb7-42ca-aeac-424dddfac646 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.353385 Jul 18 14:22:20.628020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 223/454] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:20 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:20.638117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:20.638117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:20.658901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:20.660745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:20.663269 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:20.664207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:21.417624 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:21.430359 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2fc3d4f0-b79d-4c6e-a68b-8078a39ad8fb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1516 microversion: 2.1 time: 0.800167 Jul 18 14:22:21.430985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 224/455] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:20 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1516 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:21.436989 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55dcac24-de6a-4387-9acc-f7c699daae68"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:21.438336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:21.467676 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:21.468133 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:21.468904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:21.469330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:21.622357 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:22:21.622889 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:22:21.623333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:22:21.624147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:22:21.624720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:22:21.636836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:21.637367 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:21.639378 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:21.639378 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:21.660709 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Getting quotas for project 2bba9fd8306e43b6b1cbc2dd4a789736. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:22:21.666061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Getting quotas for user 2865db5146784ee188001703d85d8809 and project 2bba9fd8306e43b6b1cbc2dd4a789736. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:22:21.678829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:22:21.682338 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:22:21.751225 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b5fafaa2-6383-43fb-99e8-a485c0594607 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454016 Jul 18 14:22:21.752028 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 232/456] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:22:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:22:21.756811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:21.757789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:21.759791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:21.765291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:21.765776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:21.766557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:21.766995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.086184 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6d6c35aa-d597-4fb7-b96e-74917d2c397f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.653441 Jul 18 14:22:22.088314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 225/457] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:22:21 2022] POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments => generated 194 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:22.097368 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:22.100244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:22.122369 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:22.123869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.125604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:22.126502 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.158374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:22.170084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:22.170921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:22.178603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:22.182789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bbde9f17-638a-45e7-9f35-3ae998b50656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.429924 Jul 18 14:22:22.183379 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 233/458] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:21 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:22.201957 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:22.218612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:22.230932 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:22.231633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.232692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:22.233453 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.535029 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:22.544293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-167bdf05-5c74-48f6-914a-18a2dc41ec02 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.454501 Jul 18 14:22:22.554572 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 226/459] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:22 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:22.559848 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:22.561331 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:22.564743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:22.570629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:22.571764 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.573097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d53855f8-cc22-44a8-bf17-efb301d20c6c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.388658 Jul 18 14:22:22.573250 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:22.573884 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:22.574142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 234/460] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:22 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:22.665907 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:22.674493 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9e6f0da0-4a15-425c-a502-aedc8f364a76 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1222 microversion: 2.1 time: 0.118511 Jul 18 14:22:22.675075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 227/461] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:22 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1222 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:22.890649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-02141f91-a67a-4d12-a5ab-e5d338703928 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'create', calling method: .version_select at 0x7fb53a3539d0>, body: {"keypair": {"name": "tempest-keypair-1958015425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF1K+kBuu2vOPmzG2Uu1T89u2hppAsK8AZCWEdMRYaceynJU/M+aebO86Y+HV8Z4Fb/4bpO50KEOreOWdTgln9k3+mB22WIcnFKWt1JnsMOBL/QZXCiw5dLuu8suTSr2lA=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:22.907208 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-02141f91-a67a-4d12-a5ab-e5d338703928 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:22:22.911208 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-02141f91-a67a-4d12-a5ab-e5d338703928 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for user 8a45cafadb824e08bd9e86fd0d5c4c71 and project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:22:22.935907 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-02141f91-a67a-4d12-a5ab-e5d338703928 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050313 Jul 18 14:22:22.936524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 235/462] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:22:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:23.201852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:23.202477 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:23.210065 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.210523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.211427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.211865 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.413494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:23.423121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:23.426027 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:23.427939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-df3124e2-28ec-4c6e-9486-930f1cfc616a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.230658 Jul 18 14:22:23.429100 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 228/463] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:23 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:23.564124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:23.564847 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:23.572921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.573601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.574850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.575376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.591488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:23.592214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:23.598386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.598818 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.599973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.600614 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.929218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:23.940276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-00f247ea-2fe6-4f2d-91c4-f0fe5a9ee8ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.352619 Jul 18 14:22:23.940952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 229/464] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:23 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:23.956082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:23.957133 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:23.962400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:23.969306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.970414 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.971200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:23.971636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:23.983156 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8d773f3f-81fe-4865-8423-c79a2292087d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.424438 Jul 18 14:22:23.985982 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 236/465] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:23 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:24.046357 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:24.055172 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9c00f9b9-e97a-4a1b-a359-c1ee24983a52 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1214 microversion: 2.1 time: 0.112576 Jul 18 14:22:24.056392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 230/466] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:23 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:24.447578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:24.448506 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:24.455771 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:24.456681 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:24.457688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:24.459013 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:24.960466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:24.963129 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:24.973165 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:24.974041 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:24.975119 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:24.975566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:25.191169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:25.199811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:25.201321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:25.202540 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9ef572e8-12f8-4af7-b398-d57d8ef721e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.759074 Jul 18 14:22:25.203119 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 237/467] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:24 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:25.207844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:25.208501 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:25.220786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:25.221357 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:25.222269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:25.222954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:25.307263 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:25.315072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5aa885d7-b19d-4acc-906e-bab136a94000 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.359116 Jul 18 14:22:25.316228 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 231/468] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:24 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:25.321356 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:25.322680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:25.331305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:25.332211 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:25.334391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:25.335089 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:25.432234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:25.445995 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-32095d4c-d998-4d2c-a66d-9f4ca8fca59b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1276 microversion: 2.1 time: 0.128229 Jul 18 14:22:25.447090 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 232/469] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:25 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1276 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:25.485994 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:25.488082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ff97738e-15c6-40b3-9240-33d7be23be79 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.283196 Jul 18 14:22:25.491466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 238/470] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:25 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:25.563157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-486457217", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e42702a6-2b2a-4d0a-b877-a03ffd658d9e"}], "security_groups": [{"name": "tempest-securitygroup--580742091"}], "key_name": "tempest-keypair-1958015425", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:25.670433 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] validate_networks() for [('e42702a6-2b2a-4d0a-b877-a03ffd658d9e', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:22:26.080891 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:22:26.081779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:22:26.081779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:22:26.082181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:22:26.082682 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:22:26.095862 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.096464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.097513 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.098030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.121306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:22:26.126050 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Getting quotas for user 8a45cafadb824e08bd9e86fd0d5c4c71 and project 38cf167c2fc74ac09d6f6d6f81829cda. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:22:26.138320 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:22:26.140730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:22:26.195557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6e0cdf58-e9f3-41f8-9b62-d47bacf72089 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.636894 Jul 18 14:22:26.196425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 233/471] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:22:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:22:26.206895 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6560785c-0f8c-4ce6-93aa-7aee82706ff8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:26.207599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6560785c-0f8c-4ce6-93aa-7aee82706ff8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:26.222880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:26.224071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:26.231265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.231771 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.232538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.232972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.264010 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6560785c-0f8c-4ce6-93aa-7aee82706ff8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.271578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6560785c-0f8c-4ce6-93aa-7aee82706ff8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1245 microversion: 2.1 time: 0.068975 Jul 18 14:22:26.273238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 239/472] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:26 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:26.335559 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:26.337635 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:26.346181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.346958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.347949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.348996 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.445431 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.457224 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.460761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.465397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ec5e9603-1c42-492c-88a8-af61d000a9c9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.243065 Jul 18 14:22:26.466646 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 234/473] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:26 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:26.482705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:26.484336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:26.493206 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.494028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.497818 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.498398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.600686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.608712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.609335 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a041ee60-7fd6-49c4-a011-33a02f2a6748 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1276 microversion: 2.1 time: 0.131806 Jul 18 14:22:26.618564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 235/474] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:26 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1276 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:26.627831 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:26.628567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:26.629556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-99944f30-19a3-44d0-bc7f-3c065e9ff490 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.299344 Jul 18 14:22:26.630653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 240/475] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:26 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:26.637831 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.638374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.639138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:26.639623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:26.796139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:26.804553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d21c9c61-285c-4e74-ac4c-fa29af05cae8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1720 microversion: 2.1 time: 0.184825 Jul 18 14:22:26.805192 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 236/476] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:26 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1720 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:27.289464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:27.290053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:27.297154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.297594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.298393 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.298825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.303499 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:27.366348 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:27.374193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8cc36e2c-be62-4b81-b381-182da63eb7ea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1249 microversion: 2.1 time: 0.089367 Jul 18 14:22:27.374763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 241/477] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:27 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1249 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:27.485302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:27.485961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:27.495058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.495946 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.496768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.497175 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.633152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:27.636230 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:27.653814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.654510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.658605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.659171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.779762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:27.795720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8f13a213-7cf7-46bd-a1bd-6518ae5bd3c4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1276 microversion: 2.1 time: 0.172190 Jul 18 14:22:27.799343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 242/478] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:27 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1276 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:27.813300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:27.814870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:27.829707 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.835264 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.837069 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.837794 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:27.839046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.846538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:27.851362 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:27.856683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f8acd624-75dc-4396-b486-b61f9cf2f57b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1722 microversion: 2.20 time: 0.376228 Jul 18 14:22:27.868122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 237/479] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:27 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1722 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:27.873391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:27.875796 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:27.882391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.883070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:27.884029 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:27.884615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.167277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:28.174706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:28.177925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0e990d61-d546-43c5-ac70-b39317a2eac6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.376760 Jul 18 14:22:28.179114 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 243/480] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:27 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:28.184403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-7a4807fd-edce-4caf-b6f2-4887f6a21b5b req-24198e61-78c3-4029-ad75-57065431dc1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2", "name": "network-vif-plugged", "status": "completed", "tag": "45c0aed7-05fa-4930-9aec-cbafd5909f17"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:28.195729 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-7a4807fd-edce-4caf-b6f2-4887f6a21b5b req-24198e61-78c3-4029-ad75-57065431dc1c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.196631 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-7a4807fd-edce-4caf-b6f2-4887f6a21b5b req-24198e61-78c3-4029-ad75-57065431dc1c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.205840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b357a4e9-bb89-417a-abc0-82aaffbefc69 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1697 microversion: 2.1 time: 0.336238 Jul 18 14:22:28.206425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 238/481] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:27 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1697 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:28.216471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-7a4807fd-edce-4caf-b6f2-4887f6a21b5b req-24198e61-78c3-4029-ad75-57065431dc1c service nova] Creating event network-vif-plugged:45c0aed7-05fa-4930-9aec-cbafd5909f17 for instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 on hv-cinder-79760 Jul 18 14:22:28.223957 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-db34ada1-4ef3-4f24-93fc-940640e232a2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:28.224096 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-7a4807fd-edce-4caf-b6f2-4887f6a21b5b req-24198e61-78c3-4029-ad75-57065431dc1c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043357 Jul 18 14:22:28.225121 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 244/482] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:28.230446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-db34ada1-4ef3-4f24-93fc-940640e232a2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.230899 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-db34ada1-4ef3-4f24-93fc-940640e232a2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.257062 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-db34ada1-4ef3-4f24-93fc-940640e232a2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Going to try to start instance {{(pid=117766) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 14:22:28.308738 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-db34ada1-4ef3-4f24-93fc-940640e232a2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action" status: 202 len: 0 microversion: 2.1 time: 0.088986 Jul 18 14:22:28.309742 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 239/483] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:22:28 2022] POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:22:28.318809 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:28.319651 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:28.329097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.329542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.330567 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.331097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.392212 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:28.393021 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:28.400133 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.400695 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.401534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.402057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.557694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:28.567337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e17b442d-68e9-40e6-b836-eaa383e02e04 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1297 microversion: 2.1 time: 0.179635 Jul 18 14:22:28.568473 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 240/484] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:28 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1297 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:28.710655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:28.721708 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bb808b23-a2c0-4bd1-be04-7b7b6d1ecc97 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1706 microversion: 2.1 time: 0.407685 Jul 18 14:22:28.722676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 245/485] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:28 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1706 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:28.816046 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:28.816662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:28.823583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.824057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.824811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.825247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.875435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:28.876476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:28.883046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.883744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:28.885810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:28.886475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.287241 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.290272 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.297684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.298056 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ac996982-e8d6-4aee-a6b7-43f4cb7c1a85 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.485749 Jul 18 14:22:29.298725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 241/486] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:28 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:29.299700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.301100 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-07daa751-1a0c-449b-be43-1c04b2fe1dc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1665 microversion: 2.20 time: 0.429562 Jul 18 14:22:29.303963 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:29.304812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.311292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.311550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 246/487] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:28 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1665 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:22:29.311957 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.312826 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.313413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.319833 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c80dc393-fbad-42ee-b0a9-67c6e3749b69"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:29.321311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.329210 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.329925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.330884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.331481 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.649532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.653138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:29.660668 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c1f11e65-2684-4185-ae67-87e28d103153 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.360479 Jul 18 14:22:29.661130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 242/488] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:29 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:29.669058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:29.670557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.679919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.679919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.680677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.681298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.695893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7dcdde44-21d3-4ea1-a4f5-475955eb202c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.380760 Jul 18 14:22:29.697809 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 247/489] 10.222.0.71 () {62 vars in 1363 bytes} [Mon Jul 18 14:22:29 2022] POST /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments => generated 188 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:22:29.745566 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:29.747432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.758817 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.759823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.770081 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.770694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.775556 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:29.783880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f588387c-c20e-4ac0-b821-344a7025318c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1303 microversion: 2.1 time: 0.121361 Jul 18 14:22:29.794105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 243/490] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:29 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:29.844322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:29.844889 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.851377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.851829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.852597 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.853025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.955877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c96c9449-e5d3-4eed-915b-70eac5866ae4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/action" status: 202 len: 0 microversion: 2.20 time: 0.115303 Jul 18 14:22:29.956423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 244/491] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 18 14:22:29 2022] POST /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:22:29.965448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:29.966094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:29.982214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.982778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:29.985161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:29.992777 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.149614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:30.159901 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1021667b-20b5-410a-97f5-2337258ae79b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1706 microversion: 2.1 time: 0.420794 Jul 18 14:22:30.169929 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 248/492] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:29 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1706 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:30.183035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-11a6fbd0-9f4b-4685-af97-079b3f4482c7 req-56798b62-161c-47e7-9fbf-65c76c579bda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e98eaf7c-8314-45fe-9c3d-6ea92634404c", "tag": "3323e765-22e5-45ba-883b-fd220d8a56aa"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:30.194856 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-11a6fbd0-9f4b-4685-af97-079b3f4482c7 req-56798b62-161c-47e7-9fbf-65c76c579bda service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.196019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-11a6fbd0-9f4b-4685-af97-079b3f4482c7 req-56798b62-161c-47e7-9fbf-65c76c579bda service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.214574 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-11a6fbd0-9f4b-4685-af97-079b3f4482c7 req-56798b62-161c-47e7-9fbf-65c76c579bda service nova] Creating event network-changed:3323e765-22e5-45ba-883b-fd220d8a56aa for instance e98eaf7c-8314-45fe-9c3d-6ea92634404c on hv-cinder-79760 Jul 18 14:22:30.222764 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-11a6fbd0-9f4b-4685-af97-079b3f4482c7 req-56798b62-161c-47e7-9fbf-65c76c579bda service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060275 Jul 18 14:22:30.224123 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 249/493] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:30.271258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:30.280299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:30.281751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:30.283279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6a5c5741-ac84-4268-8006-fe455ad60d34 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1751 microversion: 2.20 time: 0.322412 Jul 18 14:22:30.294897 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 245/494] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:29 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1751 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:30.314911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:30.315806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:30.323169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.324771 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.326239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.327002 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.636502 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:30.655981 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8755567f-8dfe-496a-9829-3465825ee59a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.343200 Jul 18 14:22:30.657925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 250/495] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:30 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:30.681046 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:30.682217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:30.684729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:30.694493 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.695107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.696104 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.696707 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.801648 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:30.803357 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:30.826781 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.827232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:30.828726 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:30.829144 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.359425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:31.366995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:31.368704 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-def8b08b-efd3-488f-a8b9-255c3f3eb3a1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1367 microversion: 2.1 time: 0.692766 Jul 18 14:22:31.387173 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6346dc2c-dd64-4a3e-bff7-84c366853692 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.590486 Jul 18 14:22:31.387993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 251/496] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:30 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:31.391224 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 246/497] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:30 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1367 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:31.392768 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:31.393388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:31.396222 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:31.396840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:31.401717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.402255 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.403204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.403638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.409819 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.410374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.411310 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.412047 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.645295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:31.647683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:31.650583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:31.658023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d19dad5-3264-4bb9-a2bd-253db934f5f0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1706 microversion: 2.1 time: 0.265061 Jul 18 14:22:31.658840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 247/498] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:31 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1706 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:31.659602 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bb4732c3-6acd-4522-9227-72b324d6fe82 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1594 microversion: 2.1 time: 0.270761 Jul 18 14:22:31.670337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:31.671557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 252/499] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:31 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1594 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:31.673208 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:31.677188 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:31.678144 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:31.685718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.686455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.687427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.688053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.692846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.693811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:31.700257 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:31.700719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.070532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:32.087344 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e8efdae4-481c-4bc9-a0cc-54a902508162 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.414377 Jul 18 14:22:32.101120 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:32.102055 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 253/500] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:31 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:32.119225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:32.120974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:32.122388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dac5ab1b-2f4b-43b3-bbae-0c75c251ca8b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1751 microversion: 2.20 time: 0.462487 Jul 18 14:22:32.126096 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 248/501] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:31 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1751 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:32.387436 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:32.388057 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:32.394579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.395124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.396285 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.396789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.408450 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:32.409297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:32.421074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.421551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.422489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.423131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.761128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:32.778037 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-074aa9ac-643b-47f1-a03f-3a6968f9ca79 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1556 microversion: 2.1 time: 0.394520 Jul 18 14:22:32.778613 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 254/502] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:32 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1556 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:32.783335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:32.784164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:32.794951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.796194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.797159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.797603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.916251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:32.928834 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-700bbed6-9be6-4bf1-9e17-7dac65fd68c1 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.528264 Jul 18 14:22:32.930249 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 249/503] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:32 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:32.938375 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:32.939343 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:32.947585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.948663 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:32.949642 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:32.950247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.106032 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9a49b34-ed6a-4641-98aa-194c9451bdc9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174334 Jul 18 14:22:33.106927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 250/504] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:22:32 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:33.118727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:33.119828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:33.127274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.127872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.128747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.129281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.199721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:33.209801 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5fed0bab-350e-479a-a369-c8dfe4bf6e25 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1710 microversion: 2.1 time: 0.429797 Jul 18 14:22:33.210610 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 255/505] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:32 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1710 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:33.221643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:33.222717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:33.230367 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.230995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.234260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.234998 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.260803 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:33.541954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:33.555810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9dc809e8-f086-4374-8f91-7ccc496116a2 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.440842 Jul 18 14:22:33.556823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 251/506] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:33 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:33.664125 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-7271063f-0c39-4575-8f53-2fad362e94eb req-8c3ed96f-7d2d-4fcc-8d5e-96bc082d928f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d05706-af03-4d2d-9a35-219ad3d890fd", "tag": "20e66e05-7f29-4c65-9267-fa171a53da05"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:33.664501 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:33.675699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:33.677280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:33.683361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-55f395ce-3fa7-408c-b59b-88ca873d3656 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1753 microversion: 2.20 time: 0.471238 Jul 18 14:22:33.684130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7271063f-0c39-4575-8f53-2fad362e94eb req-8c3ed96f-7d2d-4fcc-8d5e-96bc082d928f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.686242 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 256/507] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:33 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1753 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:33.687043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7271063f-0c39-4575-8f53-2fad362e94eb req-8c3ed96f-7d2d-4fcc-8d5e-96bc082d928f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.707247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-7271063f-0c39-4575-8f53-2fad362e94eb req-8c3ed96f-7d2d-4fcc-8d5e-96bc082d928f service nova] Creating event network-changed:20e66e05-7f29-4c65-9267-fa171a53da05 for instance 01d05706-af03-4d2d-9a35-219ad3d890fd on hv-cinder-79760 Jul 18 14:22:33.713952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-7271063f-0c39-4575-8f53-2fad362e94eb req-8c3ed96f-7d2d-4fcc-8d5e-96bc082d928f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053862 Jul 18 14:22:33.714823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 252/508] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:22:33.946712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:33.947519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:33.954524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.954974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:33.955760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:33.956217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.173705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:34.183585 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7e231bf5-5db2-4b30-ab7e-449a2677af84 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.240937 Jul 18 14:22:34.184466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 257/509] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:33 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:34.574861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:34.575657 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:34.582733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:34.583631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.584533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:34.584974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.702898 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:34.703550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:34.713521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:34.714021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.714819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:34.715827 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:34.734662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:34.745455 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f037ba66-5b71-42f7-b2af-e1481430ff34 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.174881 Jul 18 14:22:34.746581 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 253/510] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:34 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:34.879435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:34.888455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:34.889979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:34.891161 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a985f059-903f-42de-97ce-91a4dc52721b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.193704 Jul 18 14:22:34.891724 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 258/511] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:34 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:35.004896 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-03b62ee4-b0fc-4120-a660-5eab868b7bbf req-3fd5c08b-9774-4228-9d7c-a34156140209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2", "tag": "45c0aed7-05fa-4930-9aec-cbafd5909f17"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:35.014146 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-03b62ee4-b0fc-4120-a660-5eab868b7bbf req-3fd5c08b-9774-4228-9d7c-a34156140209 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.014748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-03b62ee4-b0fc-4120-a660-5eab868b7bbf req-3fd5c08b-9774-4228-9d7c-a34156140209 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.027916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-03b62ee4-b0fc-4120-a660-5eab868b7bbf req-3fd5c08b-9774-4228-9d7c-a34156140209 service nova] Creating event network-changed:45c0aed7-05fa-4930-9aec-cbafd5909f17 for instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 on hv-cinder-79760 Jul 18 14:22:35.034994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-03b62ee4-b0fc-4120-a660-5eab868b7bbf req-3fd5c08b-9774-4228-9d7c-a34156140209 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035354 Jul 18 14:22:35.036122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 254/512] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:35.203626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:35.204928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:35.214222 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.214942 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.215957 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.216539 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.389534 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:35.399113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ddbd97ae-c8a9-49f7-80df-7a26caca26a6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.200860 Jul 18 14:22:35.400109 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 259/513] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:35 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:35.763925 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:35.764839 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:35.781667 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.782220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.783067 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.783578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.910745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:35.912120 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:35.933271 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.934115 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:35.935340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:35.936004 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:36.109281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:36.135264 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:36.269227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=12 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:36.700993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:36.705740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:36.718633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b117dfc9-22f2-4c38-97b8-bc14f366fc21 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.952704 Jul 18 14:22:36.718918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:36.720000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 255/514] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:35 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:36.725293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:36.729633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:36.730967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:36.734385 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f1227342-6a84-4186-8a13-fdab9d7ea4c0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.827749 Jul 18 14:22:36.745169 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:36.746320 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:36.747121 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 260/515] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:35 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:36.748527 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:36.755810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.053370 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-ca03f354-67ee-4962-a438-d3307932359b req-af9505d4-20ac-4643-9302-272f4c5a1f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:37.063925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ca03f354-67ee-4962-a438-d3307932359b req-af9505d4-20ac-4643-9302-272f4c5a1f1f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.064541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-ca03f354-67ee-4962-a438-d3307932359b req-af9505d4-20ac-4643-9302-272f4c5a1f1f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.077808 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-ca03f354-67ee-4962-a438-d3307932359b req-af9505d4-20ac-4643-9302-272f4c5a1f1f service nova] Creating event network-changed:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:22:37.085171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-ca03f354-67ee-4962-a438-d3307932359b req-af9505d4-20ac-4643-9302-272f4c5a1f1f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036958 Jul 18 14:22:37.085799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 261/516] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:22:37.107562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-232535906"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:37.108172 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:37.109951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:37.115607 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.116017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.116845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.117278 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.118788 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5b69b164-b0aa-4c07-bf6d-73cf7175c680 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.397537 Jul 18 14:22:37.119370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 256/517] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:36 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:37.271084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.network.security_group_api [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Adding security group 182e9aae-33dc-40a0-93a2-28bb5168dc58 to port 18a33129-897d-4e1f-8fb9-17adcd5c0b2d Jul 18 14:22:37.683863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cfdd5dd1-68b2-4b26-a2b4-9dcf98918689 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/action" status: 202 len: 0 microversion: 2.1 time: 0.580512 Jul 18 14:22:37.686431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 262/518] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:22:37 2022] POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:22:37.694729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:37.695332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:37.696293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-f8e0faab-a246-43af-9705-4d800af06394 req-c9c2e2d8-7ce0-4066-b8ee-1ef111680227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:37.704914 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.705217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.706040 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.706486 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.707358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-f8e0faab-a246-43af-9705-4d800af06394 req-c9c2e2d8-7ce0-4066-b8ee-1ef111680227 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.708058 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-f8e0faab-a246-43af-9705-4d800af06394 req-c9c2e2d8-7ce0-4066-b8ee-1ef111680227 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.725528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-f8e0faab-a246-43af-9705-4d800af06394 req-c9c2e2d8-7ce0-4066-b8ee-1ef111680227 service nova] Creating event network-changed:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:22:37.731467 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-f8e0faab-a246-43af-9705-4d800af06394 req-c9c2e2d8-7ce0-4066-b8ee-1ef111680227 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040485 Jul 18 14:22:37.732725 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 263/519] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:37.738839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:37.739633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:37.748008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.748008 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.748500 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.749040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.951707 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:37.960153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-65d31530-349a-4be4-b1da-241d3d8f93fa tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1640 microversion: 2.1 time: 0.269554 Jul 18 14:22:37.966242 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 257/520] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:37 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1640 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:37.968332 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:37.969683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:37.970331 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:37.977490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.977989 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.978811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:37.979089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-88311920-c874-4cf1-ba8b-7501ec5ef171 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.245123 Jul 18 14:22:37.979264 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:37.979697 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 264/521] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:37 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:38.136363 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:38.137002 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:38.142145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:38.147217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.147899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:38.149193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.149873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:38.154760 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:38.156385 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:38.157820 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33c958c1-07e4-4d40-b072-40c2a11b9cb2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.195631 Jul 18 14:22:38.158621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 258/522] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:37 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:38.294268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:38.302050 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ffbe721b-4ab5-4e66-b37e-c93999ce697f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.169678 Jul 18 14:22:38.303348 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 265/523] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:38 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:38.535607 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-7eaeeb75-3bab-414d-8086-a18557daba1f req-6e2240a3-c094-49e2-bc31-a4aeb745029d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98eaf7c-8314-45fe-9c3d-6ea92634404c", "name": "network-vif-plugged", "status": "completed", "tag": "3323e765-22e5-45ba-883b-fd220d8a56aa"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:38.547094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7eaeeb75-3bab-414d-8086-a18557daba1f req-6e2240a3-c094-49e2-bc31-a4aeb745029d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:38.547655 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7eaeeb75-3bab-414d-8086-a18557daba1f req-6e2240a3-c094-49e2-bc31-a4aeb745029d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:38.575631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-7eaeeb75-3bab-414d-8086-a18557daba1f req-6e2240a3-c094-49e2-bc31-a4aeb745029d service nova] Creating event network-vif-plugged:3323e765-22e5-45ba-883b-fd220d8a56aa for instance e98eaf7c-8314-45fe-9c3d-6ea92634404c on hv-cinder-79760 Jul 18 14:22:38.594973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-7eaeeb75-3bab-414d-8086-a18557daba1f req-6e2240a3-c094-49e2-bc31-a4aeb745029d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062372 Jul 18 14:22:38.596647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 259/524] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:39.003319 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:39.004457 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:39.020550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:39.021025 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.022108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:39.022550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.183031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:39.185384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:39.197354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:39.198537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.200098 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:39.201254 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.209707 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:39.222108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9c35ef22-f2ce-4139-828f-4adbffbf8a3a tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.227787 Jul 18 14:22:39.222704 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 266/525] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:38 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:39.320181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:39.321132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:39.328063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:39.328601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.329703 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:39.330352 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:39.392594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:39.395247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:39.413958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:39.415783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:39.417147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-08eb3cf9-1f7e-476c-a83f-22ea84fcef95 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.241590 Jul 18 14:22:39.417734 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 260/526] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:39 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:39.488808 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:39.497627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2ae4c600-51c7-4457-a4db-84897a0b7520 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.181499 Jul 18 14:22:39.498560 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 267/527] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:39 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:40.251773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:40.252522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:40.262615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.263220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.265026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.265888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.426049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:40.435631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b0324398-032f-4b1d-9db9-a27a3bc87391 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.187944 Jul 18 14:22:40.436388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 261/528] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:40 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:40.440435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:40.441113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:40.448281 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.448724 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.449756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.450194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.519121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:40.520700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:40.527679 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.528136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.528915 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:40.529354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:40.648323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:40.657327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:40.659146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:40.660547 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f2fe9f12-874b-4710-820c-b8a762df0d05 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.224610 Jul 18 14:22:40.661071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 268/529] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:40 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:22:40.701177 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:40.710239 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-69d180c5-f2c7-4907-a524-6218f4ec2937 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.198870 Jul 18 14:22:40.711143 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 262/530] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:40 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:41.456405 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:41.457029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:41.464258 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:41.464728 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:41.465889 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:41.466711 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:41.613033 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:41.620657 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-87ef2651-8cd5-45b4-bbbc-80dcc5ec3ed7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.169369 Jul 18 14:22:41.621228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 269/531] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:41 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:41.681481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:41.682126 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:41.690051 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:41.690763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:41.691971 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:41.692399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:41.728349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:41.729299 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:41.736063 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:41.736563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:41.737772 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:41.738404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:41.908020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:41.917399 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:41.918922 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:41.920202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b1d9c71b-a9d5-4b06-b0e3-cf0c8dedb87a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.243482 Jul 18 14:22:41.921110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 263/532] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:41 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:41.940257 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:41.949043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8571b4bb-0343-4f47-9a18-8649ec53f7ad tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.224812 Jul 18 14:22:41.950301 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 270/533] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:41 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:42.273609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-95a05e92-a97b-4686-ba49-eb3a3c284df9 req-a2a673f3-de59-4dd6-952b-e5fe6f3f2b22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d05706-af03-4d2d-9a35-219ad3d890fd", "name": "network-vif-plugged", "status": "completed", "tag": "20e66e05-7f29-4c65-9267-fa171a53da05"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:42.282489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-95a05e92-a97b-4686-ba49-eb3a3c284df9 req-a2a673f3-de59-4dd6-952b-e5fe6f3f2b22 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.283032 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-95a05e92-a97b-4686-ba49-eb3a3c284df9 req-a2a673f3-de59-4dd6-952b-e5fe6f3f2b22 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:42.295708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-95a05e92-a97b-4686-ba49-eb3a3c284df9 req-a2a673f3-de59-4dd6-952b-e5fe6f3f2b22 service nova] Creating event network-vif-plugged:20e66e05-7f29-4c65-9267-fa171a53da05 for instance 01d05706-af03-4d2d-9a35-219ad3d890fd on hv-cinder-79760 Jul 18 14:22:42.300911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-95a05e92-a97b-4686-ba49-eb3a3c284df9 req-a2a673f3-de59-4dd6-952b-e5fe6f3f2b22 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031935 Jul 18 14:22:42.301770 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 264/534] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:42.637743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:42.638922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:42.652614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.653376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:42.654219 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.654697 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:42.818942 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:42.827792 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bd809ec6-c1db-4200-9def-e673a4d1f189 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.193851 Jul 18 14:22:42.828650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 271/535] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:42 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:42.940444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:42.941031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:42.948517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.949093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:42.950004 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.950557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:42.966758 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:42.967493 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:42.974636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.975191 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:42.976075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:42.976588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:43.175140 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:43.186041 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:43.187536 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:43.188864 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-27e623cd-20e7-494a-92a2-8b7a3720d3fe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.253306 Jul 18 14:22:43.189539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 265/536] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:42 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:22:43.198735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:43.207157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f8874074-d681-485a-9d8c-1aa6cb95d771 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.244327 Jul 18 14:22:43.207717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 272/537] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:42 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:43.845454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:43.846309 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:43.852962 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:43.853438 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:43.854256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:43.854656 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:43.999754 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:44.008352 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e7db8ffb-2a05-44b0-8751-2b9754e96101 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.167203 Jul 18 14:22:44.009020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 266/538] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:43 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:44.207757 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:44.208587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:44.215911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:44.216291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:44.217067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:44.217507 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:44.224579 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:44.225186 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:44.235608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:44.236055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:44.237137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:44.237637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:44.411984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:44.437766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:44.439383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:44.440026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:44.440730 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-87f7b1fc-206d-417f-b089-6029ca9355ea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.236846 Jul 18 14:22:44.441701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 273/539] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:44 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:44.448755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b26a3f40-2cec-4840-a464-02a64307d57d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.228050 Jul 18 14:22:44.449613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 267/540] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:44 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:45.025867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:45.026392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:45.032880 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:45.033334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:45.034142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:45.034580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:45.177162 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:45.180912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:45.186706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1fd26918-ecf4-4ede-a0e9-41c778b8e3fa tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.164915 Jul 18 14:22:45.187261 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 274/541] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:45 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:45.459790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:45.460440 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:45.466404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:45.467262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:45.467426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:45.467902 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:45.468674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:45.469111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:45.474760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:45.475238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:45.476029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:45.479394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:45.750712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:45.759907 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:45.764672 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-127fec30-af52-493b-ac4b-38b91f0976b6 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.302050 Jul 18 14:22:45.765529 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 275/542] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:45 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:45.769178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:45.770730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:45.772022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5e142eb4-2d9d-4ce0-9d45-e2eed93e73b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.316388 Jul 18 14:22:45.772585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 268/543] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:45 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:46.205154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:46.205761 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:46.212587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:46.213061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:46.213858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:46.214294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:46.357882 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:46.366337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fc06964c-a8c1-4b4a-9284-46f8bf18408e tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.165318 Jul 18 14:22:46.367032 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 276/544] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:46 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:46.781937 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:46.782591 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:46.790292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:46.790918 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:46.790918 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:46.791283 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:46.791755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:46.792182 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:46.795797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:46.802364 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:46.802956 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:46.803714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:46.804172 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:47.021188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:47.028164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:47.034876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-53ebf282-dfaf-43db-9507-969e3db5641b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.256906 Jul 18 14:22:47.039075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 269/545] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:46 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:47.047355 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:47.054397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:47.055774 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4fd9341f-9e07-492c-97a3-6669149b30bd tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.269516 Jul 18 14:22:47.056670 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 277/546] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:46 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:47.385411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:47.386619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:47.396083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:47.396700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:47.397491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:47.397929 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:47.542191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:47.553063 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a4e8e607-96e5-4f9c-8d6f-97dcd4c6c2fe tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.172872 Jul 18 14:22:47.553916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 270/547] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:47 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:48.053944 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:48.054813 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:48.062143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:48.062586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:48.063362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:48.063799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:48.075564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:48.076303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:48.083793 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:48.084048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:48.084829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:48.085906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:48.302441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:48.306561 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:48.311178 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5b9a4d31-669d-4abb-82ee-a8d116bcbb44 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.262022 Jul 18 14:22:48.312024 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 278/548] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:48 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:48.323683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:48.326092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:48.327686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4b9de9ed-a0c3-4c78-af77-d2fac5afb797 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.256921 Jul 18 14:22:48.328880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 271/549] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:48 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:48.571630 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:48.572290 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:48.579179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:48.579658 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:48.580422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:48.580844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:48.732659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:48.742142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4c1d3146-d9dd-4a76-936f-e2050e6e8bd7 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.175140 Jul 18 14:22:48.742708 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 279/550] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:48 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:49.328676 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:49.329446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:49.337256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:49.337741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:49.338536 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:49.338977 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:49.347034 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:49.347735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:49.354897 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:49.355355 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:49.356137 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:49.356753 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:49.552151 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:49.562462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fd248e5b-8ebb-4683-af78-266fadfbdbff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.237364 Jul 18 14:22:49.562906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 272/551] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:49 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:49.564787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:49.574366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:49.575945 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:49.577052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-88c390d8-ce14-42bf-bf8c-b1331dcece0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.234357 Jul 18 14:22:49.577640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 280/552] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:49 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:49.759786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:49.760393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:49.767425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:49.767876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:49.768683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:49.769107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:49.920382 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:49.930825 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-297794d7-6b78-423e-8bd7-676dd44a821d tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.175136 Jul 18 14:22:49.931424 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 273/553] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:49 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:50.580181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:50.580819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:50.588316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:50.588755 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:50.589550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:50.590030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:50.600124 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:50.601165 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:50.608680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:50.609137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:50.609961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:50.610398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:50.800902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:50.806993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:50.811279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3b5db2db-2938-4a5c-a3bf-0060952aa851 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.235036 Jul 18 14:22:50.811836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 281/554] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:50 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:50.822967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:50.825688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:50.827607 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-57275065-fcee-4c93-919e-419e694210ac tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.231148 Jul 18 14:22:50.828606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 274/555] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:50 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:50.949688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:50.950296 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:50.959712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:50.960738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:50.961451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:50.962568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:51.104392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:51.112967 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bbd2ce45-1658-43ea-9fd5-053bfae747b8 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.167788 Jul 18 14:22:51.113547 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 282/556] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:50 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:51.829327 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:51.830157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:51.837671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:51.838114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:51.838888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:51.839326 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:51.850238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:51.850815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:51.857980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:51.858434 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:51.859220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:51.859663 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:52.044769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:52.051307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:52.054895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d2df298e-9137-4858-a0ab-a552dd4fdf72 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.229402 Jul 18 14:22:52.055471 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 275/557] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:51 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:52.060547 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:52.062054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:52.063201 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-780a90ff-c29a-4313-b2be-34e1b98c4686 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.217009 Jul 18 14:22:52.063745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 283/558] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:51 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:52.131079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:52.131693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:52.137993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:52.138576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:52.139188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:52.139636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:52.288891 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:52.297475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-db0c6796-fd5c-4cea-b114-99589f0292f4 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.170766 Jul 18 14:22:52.298106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 276/559] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:52 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:53.072434 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:53.073061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:53.080154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:53.080565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:53.080747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:53.081451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:53.081539 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:53.082019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:53.088712 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:53.089159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:53.089983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:53.090417 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:53.290186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:53.293190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:53.297928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-72dfd969-1056-46a9-b1e0-f9c1304de4a9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.229360 Jul 18 14:22:53.298516 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 284/560] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:53 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:22:53.302848 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:53.304609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:53.305922 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-477b88d0-875c-4522-8ffa-c0764fbd048d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.229316 Jul 18 14:22:53.306684 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 277/561] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:53 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:53.314818 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:53.315431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:53.323143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:53.323478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:53.324297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:53.324740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:53.572688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:53.580520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a8d00974-aa04-4b39-8e5e-dad83e9692dc tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1318 microversion: 2.1 time: 0.269649 Jul 18 14:22:53.581016 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 285/562] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:53 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:54.317503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:54.319265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:54.325586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:54.327194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:54.327672 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:54.328141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:54.328924 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:54.329553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:54.336221 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:54.336924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:54.337873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:54.338406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:54.346130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:54.824375 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:54.829394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:54.832652 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-70a25d34-fb29-4a92-9df9-e824957e30fc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.518992 Jul 18 14:22:54.833536 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 278/563] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:54 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:54.838760 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:54.839402 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:54.847436 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:54.848081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:54.849366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:54.849544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:54.850082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:54.851337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:54.852656 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fe363446-3f22-4308-bcf4-57f67d995b25 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.531639 Jul 18 14:22:54.855514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 286/564] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:54 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:54.995827 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:55.004068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bc1e7975-12cb-4e5a-8e4e-2425f0085479 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1507 microversion: 2.1 time: 0.169252 Jul 18 14:22:55.004670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 279/565] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:54 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:55.021172 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a637bf9-8065-4256-9a12-bbe836f248b8", "device": "/dev/sdb"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:55.022383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:55.028743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:55.029187 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:55.029988 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:55.030419 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:55.736564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3756123a-7dcd-40fd-8692-6d0ca85e4784 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "POST /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.719481 Jul 18 14:22:55.737686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 287/566] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:22:55 2022] POST /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c/os-volume_attachments => generated 194 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:22:55.851243 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:55.851944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:55.858908 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:55.859183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:55.859944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:55.860376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:55.873125 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:55.873852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:55.881052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:55.881505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:55.882327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:55.882760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:56.069255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:56.080409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:56.083847 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-655d5804-e618-4760-ac20-ddc8268318b2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1370 microversion: 2.1 time: 0.235632 Jul 18 14:22:56.084469 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 280/567] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:55 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1370 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:56.090774 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:56.092329 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:56.093556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d1f53d48-aa7d-4895-a7d2-a62acc8bc80d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.225323 Jul 18 14:22:56.094151 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 288/568] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:55 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:57.101905 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:57.102454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:57.109500 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:57.109919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:57.110686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:57.111120 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:57.111867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:57.112789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:57.119866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:57.120321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:57.121090 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:57.121521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:57.326325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:57.331636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:57.336467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-00057963-fcfb-4b7f-be8f-17101e6934e3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1564 microversion: 2.1 time: 0.238906 Jul 18 14:22:57.337154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 281/569] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:22:57 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1564 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:22:57.341334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:57.342878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:57.344045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bac899cb-93c8-4778-9461-f561a0d2cc1b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.236128 Jul 18 14:22:57.344555 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 289/570] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:57 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:57.353823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:57.354315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:57.360594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:57.361048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:57.361903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:57.362723 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:57.445776 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ad9b056d-188e-4150-b933-e0226e329e32 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095994 Jul 18 14:22:57.446368 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 282/571] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:22:57 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:58.363375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:58.364142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:58.371247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:58.371686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:58.372465 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:58.372882 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:58.377358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:22:58.579480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:58.589407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:58.590999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:58.592188 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b059ab1b-d019-48f3-a0b3-a9cf36afe1b6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.233146 Jul 18 14:22:58.592921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 290/572] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:58 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:22:58.730347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-737d18ee-a7ed-4afd-9ec7-2b0925760ac9 req-b84333c5-85c2-43d3-b9fa-ce2a59af58df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d05706-af03-4d2d-9a35-219ad3d890fd", "tag": "20e66e05-7f29-4c65-9267-fa171a53da05"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:22:58.739757 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-737d18ee-a7ed-4afd-9ec7-2b0925760ac9 req-b84333c5-85c2-43d3-b9fa-ce2a59af58df service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:58.740101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-737d18ee-a7ed-4afd-9ec7-2b0925760ac9 req-b84333c5-85c2-43d3-b9fa-ce2a59af58df service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:58.752424 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-737d18ee-a7ed-4afd-9ec7-2b0925760ac9 req-b84333c5-85c2-43d3-b9fa-ce2a59af58df service nova] Creating event network-changed:20e66e05-7f29-4c65-9267-fa171a53da05 for instance 01d05706-af03-4d2d-9a35-219ad3d890fd on hv-cinder-79760 Jul 18 14:22:58.758132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-737d18ee-a7ed-4afd-9ec7-2b0925760ac9 req-b84333c5-85c2-43d3-b9fa-ce2a59af58df service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031797 Jul 18 14:22:58.758665 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 283/573] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:22:59.611558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:22:59.612719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:22:59.621009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:59.621570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:59.622422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:22:59.622858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:22:59.801432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:59.813196 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:59.815243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:22:59.816468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c5756700-3b11-4216-86cc-cdf66133bb7d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.209134 Jul 18 14:22:59.817189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 291/574] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:22:59 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:00.836425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:00.837295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:00.839868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=76 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:00.846478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:00.846944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:00.847747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:00.848219 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:01.008072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:01.017807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:01.019362 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:01.021195 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1cb1ffa4-a543-4b1d-8f5b-0cb2857c0d77 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.189049 Jul 18 14:23:01.021776 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 284/575] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:00 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:02.041366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:02.041965 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:02.049239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:02.049694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:02.050510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:02.050923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:02.203514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:02.212625 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:02.214194 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:02.215426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3934a675-d20a-4e1e-b95d-3f4bc3a1cdb0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.178838 Jul 18 14:23:02.225925 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 292/576] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:02 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:03.244435 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:03.245174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:03.252275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:03.252707 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:03.253493 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:03.254002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:03.406073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:03.415789 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:03.417495 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:03.418688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0d6ee6b7-2de4-4760-848b-77f1cee87284 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.178112 Jul 18 14:23:03.419177 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 285/577] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:03 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:04.392304 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-de14f48a-b90c-4fcc-ad6f-e1ac2ac45106 req-f57dec2a-ef27-4abe-9548-559f1045b612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "name": "network-vif-plugged", "status": "completed", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:04.403052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-de14f48a-b90c-4fcc-ad6f-e1ac2ac45106 req-f57dec2a-ef27-4abe-9548-559f1045b612 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:04.404146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-de14f48a-b90c-4fcc-ad6f-e1ac2ac45106 req-f57dec2a-ef27-4abe-9548-559f1045b612 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:04.420670 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-de14f48a-b90c-4fcc-ad6f-e1ac2ac45106 req-f57dec2a-ef27-4abe-9548-559f1045b612 service nova] Creating event network-vif-plugged:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:23:04.426645 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-de14f48a-b90c-4fcc-ad6f-e1ac2ac45106 req-f57dec2a-ef27-4abe-9548-559f1045b612 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037506 Jul 18 14:23:04.427959 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 293/578] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:23:04.436987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:04.437987 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:04.447625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:04.448750 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:04.450830 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:04.451526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:04.653244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:04.664522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:04.666698 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:04.668186 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b379ee3f-ec8d-41f1-85a3-8a4de6c580b7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.235498 Jul 18 14:23:04.668993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 286/579] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:04 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:05.688679 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:05.689350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:05.697611 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:05.698099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:05.698911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:05.699349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:05.850503 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:05.864621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:05.867335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:05.869175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-29c372b6-2527-4ac2-b9cc-90e5d796996e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.184895 Jul 18 14:23:05.870128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 294/580] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:05 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:06.889287 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:06.889952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:06.897874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:06.898334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:06.899132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:06.899606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:07.058361 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:07.068460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:07.070062 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:07.071286 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6fdeb1f2-59c9-4973-b93a-e39713f15db8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.186376 Jul 18 14:23:07.071826 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 287/581] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:06 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:08.096017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:08.096804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:08.104369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:08.104842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:08.105627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:08.106164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:08.268140 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:08.280073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:08.281538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:08.282797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-56d88238-9317-4d26-aceb-a0778027fa57 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.190968 Jul 18 14:23:08.283387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 295/582] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:08 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:09.302802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:09.303708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:09.311033 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:09.311532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:09.312352 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:09.312790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:09.470257 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:09.487479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:09.489363 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:09.490809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-72c1f582-34ff-4420-9c0d-ec34537bd819 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.192176 Jul 18 14:23:09.491253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 288/583] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:09 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:10.509483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:10.511768 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:10.520632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:10.521166 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:10.522146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:10.522580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:10.682044 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:10.692756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:10.694662 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:10.695976 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cbf76383-baf7-4052-8686-8ddc8e653393 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.190594 Jul 18 14:23:10.696609 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 296/584] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:10 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:11.718868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:11.719478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:11.726883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:11.727332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:11.728113 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:11.728542 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:11.870521 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:11.882076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:11.884129 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:11.885537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-446dc503-942e-4aac-86e6-587782260460 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.171081 Jul 18 14:23:11.886162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 289/585] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:11 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:12.904719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:12.905371 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:12.912630 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:12.913092 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:12.913926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:12.914360 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:13.060380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:13.070595 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:13.072721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:13.074446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ed614c05-c085-4139-9303-90be726b0123 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.173855 Jul 18 14:23:13.075856 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 297/586] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:12 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:14.098671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:14.099511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:14.108573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:14.109101 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:14.109900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:14.110369 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:14.262626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:14.272357 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:14.274616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:14.275814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e982f9ea-754e-4fe4-bbef-62ea1c807eba tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1809 microversion: 2.20 time: 0.183336 Jul 18 14:23:14.276330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 290/587] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:14 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:15.294082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:15.294685 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:15.301687 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:15.302180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:15.302970 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:15.303397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:15.443519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:15.452292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:15.453816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:15.455007 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7b8d7c64-f8bd-43e1-8a83-b5ecddc76e4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1796 microversion: 2.20 time: 0.164921 Jul 18 14:23:15.455561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 298/588] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:23:15 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1796 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:23:16.416205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:16.416842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:16.423715 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:16.424163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:16.424944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:16.425369 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:16.522691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lazy-loading 'services' on Instance uuid e98eaf7c-8314-45fe-9c3d-6ea92634404c {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:23:16.606483 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5559f30c-0451-44eb-a20e-7509d5305c9b tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c/os-volume_attachments/2a637bf9-8065-4256-9a12-bbe836f248b8" status: 202 len: 0 microversion: 2.1 time: 0.194098 Jul 18 14:23:16.607126 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 291/589] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:23:16 2022] DELETE /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c/os-volume_attachments/2a637bf9-8065-4256-9a12-bbe836f248b8 => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:23:18.790628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:18.791218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:18.793684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=44 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:18.799345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.799722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.800467 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.801046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.828475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:23:18.916631 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6c4d44e6-9eaa-4da8-863b-8292fc633b07 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 204 len: 0 microversion: 2.1 time: 0.129505 Jul 18 14:23:18.917241 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 299/590] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:23:18 2022] DELETE /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:23:18.927976 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:18.928671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:18.935933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.936387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:18.937179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:18.937620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:19.085150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:19.093439 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4f940a92-27de-4f63-bd88-af5265b0ff50 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1513 microversion: 2.1 time: 0.170694 Jul 18 14:23:19.094188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 292/591] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:18 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1513 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:20.112792 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:20.114030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:20.121313 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.121788 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.122570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:20.123002 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:20.275983 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:20.285223 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aeb6449c-d120-45e1-b120-d5d6ad2e3e91 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1513 microversion: 2.1 time: 0.177232 Jul 18 14:23:20.285926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 300/592] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:20 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:21.305892 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:21.306545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:21.316745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.317170 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.317977 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:21.318412 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:21.460481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:21.468404 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9566a92-6a53-42a4-8f02-c20a4a7316c1 tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1513 microversion: 2.1 time: 0.168594 Jul 18 14:23:21.468981 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 293/593] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:21 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:22.426905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-0827fe33-dcbd-452e-b6e8-6b17ac0a53e6 req-78733deb-0735-4d2b-b915-6edb2d0dd139 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e98eaf7c-8314-45fe-9c3d-6ea92634404c", "name": "network-vif-deleted", "tag": "3323e765-22e5-45ba-883b-fd220d8a56aa"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:22.438933 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-0827fe33-dcbd-452e-b6e8-6b17ac0a53e6 req-78733deb-0735-4d2b-b915-6edb2d0dd139 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.439396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-0827fe33-dcbd-452e-b6e8-6b17ac0a53e6 req-78733deb-0735-4d2b-b915-6edb2d0dd139 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.457162 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-0827fe33-dcbd-452e-b6e8-6b17ac0a53e6 req-78733deb-0735-4d2b-b915-6edb2d0dd139 service nova] Creating event network-vif-deleted:3323e765-22e5-45ba-883b-fd220d8a56aa for instance e98eaf7c-8314-45fe-9c3d-6ea92634404c on hv-cinder-79760 Jul 18 14:23:22.462299 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-0827fe33-dcbd-452e-b6e8-6b17ac0a53e6 req-78733deb-0735-4d2b-b915-6edb2d0dd139 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039525 Jul 18 14:23:22.462904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 301/594] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:22.487695 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:22.488969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:22.498272 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.500745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.501643 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:22.502118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:22.588283 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2865db5146784ee188001703d85d8809', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bba9fd8306e43b6b1cbc2dd4a789736', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:22.596634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e48dece4-c67a-4696-81c5-d0d6d0eddbce tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 200 len: 1303 microversion: 2.1 time: 0.114074 Jul 18 14:23:22.597919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 294/595] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:22 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:23:23.619229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:23.619940 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] [instance: e98eaf7c-8314-45fe-9c3d-6ea92634404c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:23.628679 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.629255 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.630056 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:23.630493 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:23.645019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] HTTP exception thrown: Instance e98eaf7c-8314-45fe-9c3d-6ea92634404c could not be found. Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Request method failure captured: Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c HTTP/1.1 Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wwc4-qReyN6QwnJLeKc6Lau0wUJ6D5ePjSyZcwouj_2upvZirtYwxcUJnScYa9z0DEjNRnwgu2o_EvF1v3J2xIVb2qD1fksyrhldKGQV9WlSOEC7db2pl_T42XsUC5fKOVIxrYqfnKqqnIB6QftfMvTUeV_lWivTv1uLt9lJNIh3wE Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 2bba9fd8306e43b6b1cbc2dd4a789736 Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesSnapshotTestJSON-171614860 Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:23:23.646733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/2bba9fd8306e43b6b1cbc2dd4a789736"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/2bba9fd8306e43b6b1cbc2dd4a789736"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/2bba9fd8306e43b6b1cbc2dd4a789736"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_2bba9fd8306e43b6b1cbc2dd4a789736", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesSnapshotTestJSON-171614860 Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 2bba9fd8306e43b6b1cbc2dd4a789736 Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-171614860 Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesSnapshotTestJSON-171614860-project Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 2865db5146784ee188001703d85d8809 Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesSnapshotTestJSON-171614860-project Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance e98eaf7c-8314-45fe-9c3d-6ea92634404c could not be found. Jul 18 14:23:23.648294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'e98eaf7c-8314-45fe-9c3d-6ea92634404c'} Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e98eaf7c-8314-45fe-9c3d-6ea92634404c could not be found. Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:23.649212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e98eaf7c-8314-45fe-9c3d-6ea92634404c could not be found. Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e98eaf7c-8314-45fe-9c3d-6ea92634404c could not be found. Jul 18 14:23:23.650606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:23.651706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] Returning 404 to user: Instance e98eaf7c-8314-45fe-9c3d-6ea92634404c could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:23.651706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-21eb4205-79bb-4428-86e0-eaf98a86b27f tempest-VolumesSnapshotTestJSON-171614860 tempest-VolumesSnapshotTestJSON-171614860-project] 10.222.0.71 "GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c" status: 404 len: 111 microversion: 2.1 time: 0.037035 Jul 18 14:23:23.651706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 302/596] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:23 2022] GET /compute/v2.1/servers/e98eaf7c-8314-45fe-9c3d-6ea92634404c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:26.633426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:26.634931 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:26.642464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.642940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.643711 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.644151 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.647539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:26.733961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a057fb9c-93ee-49ac-a6e6-e5c8f1f608fb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/action" status: 202 len: 0 microversion: 2.1 time: 0.103852 Jul 18 14:23:26.734638 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 295/597] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:23:26 2022] POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:23:26.743376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:26.743984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:26.751006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.751543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.752421 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:26.752940 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:26.910913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:26.919030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-91570c00-449c-46f4-84e6-f7a23cda64e5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1751 microversion: 2.1 time: 0.179590 Jul 18 14:23:26.919637 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 303/598] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:26 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:27.938394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:27.938961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:27.945952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:27.946403 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:27.947170 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:27.947604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:28.107643 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:28.116666 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c39bd79e-12ca-44d8-85aa-464f87cbc194 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1751 microversion: 2.1 time: 0.183192 Jul 18 14:23:28.117232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 296/599] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:27 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1751 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:29.136280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:29.137163 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:29.143834 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:29.144305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:29.145246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:29.145686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:29.148503 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:29.301048 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:29.309900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6f767b0e-40cb-4e74-9613-5c4f8d105840 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1751 microversion: 2.1 time: 0.177448 Jul 18 14:23:29.310487 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 304/600] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:29 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1751 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:30.329836 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:30.330523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:30.339660 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.340310 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.341434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:30.342146 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:30.736389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:30.745037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a769cf5a-1927-4c7e-af99-0a8aff8b4beb tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.420758 Jul 18 14:23:30.745582 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 297/601] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:30 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:31.763997 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:31.764648 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:31.771950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.772495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.773259 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:31.773696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:31.924804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:31.933114 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-19b699f1-3e51-4487-861c-a8db8b7904a9 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.173007 Jul 18 14:23:31.933773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 305/602] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:31 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:32.951504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:32.952141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:32.955234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=28 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:32.960992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.961444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:32.962258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:32.962693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:33.121956 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:33.131354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-66d77670-d4e6-4099-a068-385b16c6703c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.183849 Jul 18 14:23:33.131921 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 298/603] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:32 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:34.151362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:34.152034 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:34.162904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:34.162904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:34.162904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:34.163199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:34.330307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:34.339020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-18724629-3045-48c3-8e95-cb3063a4e82a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.193338 Jul 18 14:23:34.339593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 306/604] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:34 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:35.357299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:35.357946 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:35.365348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:35.365836 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:35.366603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:35.367030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:35.522261 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:35.530834 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7b918d51-38ff-445e-9f49-3f300ab0f09c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.177514 Jul 18 14:23:35.531413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 299/605] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:35 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:36.550507 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:36.551319 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:36.558406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:36.558895 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:36.559669 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:36.560106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:36.723563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:36.732564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9a226033-4e18-46a4-b515-4ff87063bc7e tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.186024 Jul 18 14:23:36.733116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 307/606] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:36 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:37.750887 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:37.751422 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:37.758623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.759107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.760043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:37.760503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:37.925564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:37.934631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-10ce24b0-027c-4e6a-ab61-bd3aba68c272 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.187660 Jul 18 14:23:37.935210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 300/607] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:37 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:38.952314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:38.952941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:38.960575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:38.961011 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:38.961812 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:38.962250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:39.124217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:39.132875 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b5325378-c36c-479c-842f-42081b73f50c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.184409 Jul 18 14:23:39.133445 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 308/608] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:38 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:40.151461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:40.152181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:40.158953 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.159413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.160189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:40.160626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:40.316745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:40.326568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e82ee4f8-1312-43e9-b749-a2b7158d51b0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.179133 Jul 18 14:23:40.327163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 301/609] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:40 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:41.345430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:41.346046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:41.353381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:41.353886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:41.354675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:41.355083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:41.517810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:41.526643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7ff664f1-d7f4-4305-b3f2-e00e262ad374 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.185124 Jul 18 14:23:41.527215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 309/610] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:41 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:42.545451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:42.546179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:42.554871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:42.555328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:42.556107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:42.556543 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:42.712746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:42.721976 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6ada54b9-7e1b-49ae-b83d-6553da7e4da4 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.181824 Jul 18 14:23:42.722568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 302/611] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:42 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:43.741719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:43.742424 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:43.749469 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:43.749986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:43.750732 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:43.751132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:43.901701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:43.914409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4622ff26-282a-432a-bb19-c22c59246dd0 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.176522 Jul 18 14:23:43.915212 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 310/612] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:43 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:44.030608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:44.031223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:44.038162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:44.038649 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:44.039526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:44.039958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:44.129360 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lazy-loading 'services' on Instance uuid 3954bb52-b979-4fd0-84c0-c95c060085eb {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:23:44.213091 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ee16746e-a7b2-4383-987a-2f5920f2fa1b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-volume_attachments/def0a592-45fd-4933-872d-758e1f03ff1e" status: 202 len: 0 microversion: 2.1 time: 0.186181 Jul 18 14:23:44.213849 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 303/613] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:23:44 2022] DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-volume_attachments/def0a592-45fd-4933-872d-758e1f03ff1e => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:23:44.936133 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:44.936905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:44.944798 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:44.945428 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:44.946297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:44.946707 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:45.098415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:45.107892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a173b664-5429-4311-9433-8387fd374027 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.175682 Jul 18 14:23:45.108496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 311/614] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:44 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:45.341074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0678c15e-cdce-48c5-9f86-a233da96b816 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:45.349566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0678c15e-cdce-48c5-9f86-a233da96b816 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:45.350428 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0678c15e-cdce-48c5-9f86-a233da96b816 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:45.378299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0678c15e-cdce-48c5-9f86-a233da96b816 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Going to try to stop instance {{(pid=117766) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 18 14:23:45.435016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0678c15e-cdce-48c5-9f86-a233da96b816 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action" status: 202 len: 0 microversion: 2.1 time: 0.100129 Jul 18 14:23:45.435561 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 304/615] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:23:45 2022] POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:23:45.445984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:45.446605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:45.452814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:45.453359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:45.454467 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:45.455575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:45.603569 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:45.613770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e1bec512-5314-411d-96ce-0f63fa9e28c7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.172388 Jul 18 14:23:45.614347 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 312/616] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:45 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:46.126774 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:46.127472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:46.135181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:46.135756 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:46.136956 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:46.137498 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:46.307318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:46.315735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a799e5df-c3e6-4c8a-9096-feabc88feb5d tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.193297 Jul 18 14:23:46.316299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 305/617] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:46 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:46.632643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:46.633243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:46.640269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:46.641006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:46.641475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:46.641961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:46.787519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:46.795836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a4541d63-e066-4b15-8324-60566286e6de tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.167553 Jul 18 14:23:46.796412 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 313/618] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:46 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:47.338242 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:47.339078 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:47.347789 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:47.348557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:47.349356 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:47.350154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:47.532062 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:47.542819 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aed1d6e0-064d-4905-a5b6-ac9b09e948c5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.209773 Jul 18 14:23:47.544111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 306/619] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:47 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:47.813813 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:47.814507 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:47.822161 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:47.822614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:47.823446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:47.824052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:47.969582 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:47.977757 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7092e450-b4d6-4531-a044-e9ccf4eadc5b tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.168036 Jul 18 14:23:47.978557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 314/620] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:47 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:48.563618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:48.564174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:48.574354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:48.575020 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:48.577342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:48.577342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:48.738044 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:48.747463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e42a96a4-fe04-4132-b64d-91f46e215a88 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.189517 Jul 18 14:23:48.748121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 307/621] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:48 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:48.996043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:48.996622 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:48.999064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:49.004666 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:49.005106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:49.005907 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:49.006323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:49.151173 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:49.159653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8a1d3ccf-091d-43a3-9a44-655722d4c197 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.167539 Jul 18 14:23:49.160270 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 315/622] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:48 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:49.767427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:49.769291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:49.775666 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:49.776285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:49.777122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:49.777549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:49.950016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:49.958393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c54e4ffc-6ba4-4c99-ad73-370d3901c3d6 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1756 microversion: 2.1 time: 0.196524 Jul 18 14:23:49.959526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 308/623] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:49 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:50.180235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:50.180853 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:50.189388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.189893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.190677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.191114 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.337976 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:50.345981 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-73e285b3-1652-4e2e-b144-79ad1fecbf8a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.171512 Jul 18 14:23:50.346544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 316/624] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:50 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:50.977259 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:50.978017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:50.985365 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.986055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.987450 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:50.988077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:50.992402 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:51.154218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:51.162693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9d8b1dc-c4dc-4ef7-9933-bbb497ef8ab5 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1759 microversion: 2.1 time: 0.189658 Jul 18 14:23:51.165965 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 309/625] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:50 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1759 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:51.364356 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:51.364949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:51.372642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:51.373078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:51.373893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:51.374327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:51.515769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:51.524053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-73bed11a-04fe-4a63-91c0-bd6886cab529 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.164093 Jul 18 14:23:51.524629 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 317/626] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:51 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:52.542741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:52.543382 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:52.550552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:52.551011 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:52.551790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:52.552221 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:52.696601 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:52.705432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-93026c0e-bd60-4cde-b561-0340b6420c52 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.166980 Jul 18 14:23:52.706041 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 310/627] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:52 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:53.725627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:53.726308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:53.733423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:53.733914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:53.734782 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:53.735236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:53.870334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:53.881528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5c4db3b1-0b08-4952-b5e2-3bff998bec4e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.161772 Jul 18 14:23:53.882228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 318/628] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:53 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:54.055829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:54.056440 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:54.063199 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.063659 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.064434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.064871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.090952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5c2faa17-eebc-4d9b-99f0-1661f4b55fd4 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/ips" status: 200 len: 149 microversion: 2.1 time: 0.039170 Jul 18 14:23:54.091623 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 311/629] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:23:54 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:54.107030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d3284d44-d7ea-4716-8172-ada3ccfba70c"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:54.108580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:54.118663 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.119308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.120492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.121152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.218004 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Invalid volume: volume d3284d44-d7ea-4716-8172-ada3ccfba70c is already attached to instances: da73439b-b34f-42fb-b28a-9fa41604ab3c Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: POST /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/os-volume_attachments HTTP/1.1 Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 74 Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:23:54.219633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {"volumeAttachment": {"volumeId": "d3284d44-d7ea-4716-8172-ada3ccfba70c"}} Jul 18 14:23:54.221181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Invalid volume: volume d3284d44-d7ea-4716-8172-ada3ccfba70c is already attached to instances: da73439b-b34f-42fb-b28a-9fa41604ab3c Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'server_id': '9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2', 'body': {'volumeAttachment': {'volumeId': 'd3284d44-d7ea-4716-8172-ada3ccfba70c'}}} Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume d3284d44-d7ea-4716-8172-ada3ccfba70c is already attached to instances: da73439b-b34f-42fb-b28a-9fa41604ab3c Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:54.222043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume d3284d44-d7ea-4716-8172-ada3ccfba70c is already attached to instances: da73439b-b34f-42fb-b28a-9fa41604ab3c Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:54.224349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume d3284d44-d7ea-4716-8172-ada3ccfba70c is already attached to instances: da73439b-b34f-42fb-b28a-9fa41604ab3c Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 400 to user: Invalid volume: volume d3284d44-d7ea-4716-8172-ada3ccfba70c is already attached to instances: da73439b-b34f-42fb-b28a-9fa41604ab3c {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c5f8a942-2183-453c-8715-2c272918ebae tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120905 Jul 18 14:23:54.226667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 319/630] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:23:54 2022] POST /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:23:54.232485 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:54.232990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:54.241789 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.242555 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.243446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.243946 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.275639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:23:54.373749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-65d774b3-5850-4307-ab9b-77b68d34aebf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 204 len: 0 microversion: 2.1 time: 0.144877 Jul 18 14:23:54.374476 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 312/631] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:23:54 2022] DELETE /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:23:54.383384 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:54.383993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:54.390878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.391406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.392213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.392776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.532439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:54.534748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:23:54.542068 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-31bcf23d-feee-4c1b-8c7b-44719e1ea09f tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1681 microversion: 2.1 time: 0.162797 Jul 18 14:23:54.542646 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 320/632] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:54 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:23:54.901506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:54.902264 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:54.911890 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.912428 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:54.913324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:54.913837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:55.121863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:55.129708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-baac7962-7436-4c28-b49a-39a57b22e75e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.233111 Jul 18 14:23:55.130241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 313/633] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:54 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:55.561375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:55.562386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:55.572833 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:55.573304 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:55.574162 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:55.574562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:55.719224 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:55.727365 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cadb6c5f-cc4e-43c2-98f8-ba57affb1a1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1681 microversion: 2.1 time: 0.170126 Jul 18 14:23:55.728138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 321/634] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:55 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:56.149376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:56.150127 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:56.157806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:56.158245 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:56.159016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:56.159486 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:56.310846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:56.318718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cce47e27-1c04-4e30-9c99-96512c4a837a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.175248 Jul 18 14:23:56.319232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 314/635] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:56 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:56.747844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:56.748596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:56.756861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:56.757317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:56.758505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:56.758904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:56.911227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:56.920111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-73522ce8-1ced-40d2-92ca-bb1a3c7381d0 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1681 microversion: 2.1 time: 0.175687 Jul 18 14:23:56.921062 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 322/636] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:56 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:57.290897 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-dc845f2a-3ad4-4f7e-a8c1-9cd987232f57 req-eb780387-9a35-40d4-9f22-4d26fbb75a38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2", "name": "network-vif-deleted", "tag": "45c0aed7-05fa-4930-9aec-cbafd5909f17"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:57.306415 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dc845f2a-3ad4-4f7e-a8c1-9cd987232f57 req-eb780387-9a35-40d4-9f22-4d26fbb75a38 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.307054 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dc845f2a-3ad4-4f7e-a8c1-9cd987232f57 req-eb780387-9a35-40d4-9f22-4d26fbb75a38 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.331181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-dc845f2a-3ad4-4f7e-a8c1-9cd987232f57 req-eb780387-9a35-40d4-9f22-4d26fbb75a38 service nova] Creating event network-vif-deleted:45c0aed7-05fa-4930-9aec-cbafd5909f17 for instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 on hv-cinder-79760 Jul 18 14:23:57.336656 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-dc845f2a-3ad4-4f7e-a8c1-9cd987232f57 req-eb780387-9a35-40d4-9f22-4d26fbb75a38 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049514 Jul 18 14:23:57.338144 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:57.338893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:57.340942 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 315/637] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:57.346545 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.347458 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.348531 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.349132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.526082 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:57.534418 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7c48c0f3-57c6-408f-83c3-96c5f28a92ce tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.201654 Jul 18 14:23:57.535015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 323/638] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:57 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:57.756868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "736c40c7-6d40-469a-8fd5-f8eb767612ef"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:23:57.766152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:57.779387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.779850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.780639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.781076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.939560 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:57.940158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:57.957214 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.957800 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:57.958652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:57.959143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:58.048426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:58.055113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:58.057631 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lazy-loading 'fault' on Instance uuid 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:23:58.112649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:58.125077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a1e177d0-9173-43d8-9df7-af7eac5f3809 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 200 len: 1332 microversion: 2.1 time: 0.190225 Jul 18 14:23:58.127944 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 324/639] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:57 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 1332 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:23:58.211601 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9503fc13-01b0-4da2-bc91-394a011a5b49 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458907 Jul 18 14:23:58.213079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 316/640] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:23:57 2022] POST /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments => generated 194 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:23:58.555014 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:58.555961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:58.563072 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:58.563528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:58.564351 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:58.564930 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:58.725722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:23:58.734068 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0d0e6ed6-d33e-4550-a02f-eef0db5842e8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.185290 Jul 18 14:23:58.744747 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 325/641] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:58 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:23:59.150622 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:59.151273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:59.161029 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:59.161731 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:59.162791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:59.163446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:59.178723 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 HTTP/1.1 Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:23:59.181042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:23:59.182629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2'} Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:23:59.183538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:23:59.184993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:23:59.186325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:23:59.186325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e376721e-9d91-4296-89d5-23419eda8aad tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 404 len: 111 microversion: 2.1 time: 0.040023 Jul 18 14:23:59.186325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 317/642] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:59 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:23:59.191689 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7514adcd-aef9-43ba-84bb-4533d50cd174 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '.version_select at 0x7fb53a15f310>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:59.213686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7514adcd-aef9-43ba-84bb-4533d50cd174 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295425227" status: 202 len: 0 microversion: 2.1 time: 0.025781 Jul 18 14:23:59.214348 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 326/643] 10.222.0.71 () {58 vars in 1220 bytes} [Mon Jul 18 14:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1295425227 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:23:59.755149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:23:59.755808 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:23:59.762866 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:59.763318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:59.764069 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:23:59.764700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:23:59.997289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:00.013131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cba6a5b0-61fa-44ee-865c-afc186ae680f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.261527 Jul 18 14:24:00.014155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 318/644] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:23:59 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:24:00.063376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:00.063872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:00.070688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:00.071150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:00.071960 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:00.072399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:00.213476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lazy-loading 'services' on Instance uuid da73439b-b34f-42fb-b28a-9fa41604ab3c {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:24:00.346961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d31a6e12-f866-402a-8522-ff103cdf8126 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments/d3284d44-d7ea-4716-8172-ada3ccfba70c" status: 202 len: 0 microversion: 2.1 time: 0.288072 Jul 18 14:24:00.347603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 327/645] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:24:00 2022] DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments/d3284d44-d7ea-4716-8172-ada3ccfba70c => generated 0 bytes in 290 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:24:00.362742 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:00.364447 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:00.371650 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:00.372130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:00.373220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:00.374045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:00.410181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2b8e403d-c0e7-4fd4-9dc9-b71dc97536f7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054504 Jul 18 14:24:00.410770 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 319/646] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:00 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:01.033141 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:01.033877 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:01.041553 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:01.042146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:01.043382 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:01.044055 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:01.212352 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:01.220695 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fd4d1799-256c-4172-a0cd-5ad04ff8aba3 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1674 microversion: 2.1 time: 0.191778 Jul 18 14:24:01.221356 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 328/647] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:01 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1674 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:01.424731 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:01.425786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:01.434322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:01.434958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:01.435955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:01.436412 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:01.469914 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-17158a77-4d37-49b8-aba0-89f854a4cc7a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050063 Jul 18 14:24:01.470732 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 320/648] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:01 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:02.245095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:02.245784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:02.254445 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.255085 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.256131 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.256760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.392328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:02.401462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-60c6ae44-643d-4b28-983a-f829e6e7a92f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1651 microversion: 2.1 time: 0.162133 Jul 18 14:24:02.402078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 329/649] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:02 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1651 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:02.418714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4424fb6e-1735-453e-b504-5973d2c5daba tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:02.426269 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4424fb6e-1735-453e-b504-5973d2c5daba tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.426883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4424fb6e-1735-453e-b504-5973d2c5daba tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.450543 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4424fb6e-1735-453e-b504-5973d2c5daba tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Going to try to start instance {{(pid=117766) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 18 14:24:02.484902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:02.486010 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:02.493193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.493920 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.494715 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.495245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.499646 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4424fb6e-1735-453e-b504-5973d2c5daba tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action" status: 202 len: 0 microversion: 2.1 time: 0.085170 Jul 18 14:24:02.500226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 321/650] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:24:02 2022] POST /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:24:02.509248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:02.510060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:02.516683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.517243 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.518199 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:02.518634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:02.529615 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5fc9ab96-61b7-4466-9e74-b0bbd6d45422 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049237 Jul 18 14:24:02.530252 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 330/651] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:02 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:02.843988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:02.852757 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-03079a42-50ae-4729-9dd8-ce35da2305ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1660 microversion: 2.1 time: 0.347572 Jul 18 14:24:02.853318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 322/652] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:02 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1660 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:03.542526 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:03.543449 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:03.550373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:03.550809 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:03.551599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:03.552040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:03.581678 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-57e47949-e6de-492b-b5e9-d90f81f4b1cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043304 Jul 18 14:24:03.582240 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 331/653] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:03 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:03.874138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:03.874691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:03.877626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:03.884304 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:03.884755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:03.885585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:03.886058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:03.902210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:04.028944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:04.038327 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1eaad80a-0152-46b1-b14d-2f1eaf5c0bd9 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1660 microversion: 2.1 time: 0.170206 Jul 18 14:24:04.038926 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 323/654] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:03 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1660 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:04.597423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:04.598263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:04.605999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:04.606450 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:04.607218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:04.608039 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:04.646398 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bd3235fb-6442-4152-986e-10f3a96f9378 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055123 Jul 18 14:24:04.646939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 332/655] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:04 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:05.056942 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:05.057634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:05.066154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.066620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.067770 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.068332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.228707 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:05.239274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c65c635e-4560-4c94-b346-8bf05cb559b2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1664 microversion: 2.1 time: 0.186252 Jul 18 14:24:05.239934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 324/656] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:05 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1664 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:05.665786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:05.667577 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:05.675104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.675552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.676325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.677052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.710060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a0f58797-9866-4eee-a8b7-0c532f9d5b66 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053591 Jul 18 14:24:05.710623 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 333/657] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:05 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:05.858341 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:05.859298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:05.866150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.866593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.867383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:05.867819 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:05.893181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lazy-loading 'flavor' on Instance uuid 01d05706-af03-4d2d-9a35-219ad3d890fd {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:24:06.027710 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a795e485-6bdb-49fc-bd73-1906f7a47424 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/action" status: 200 len: 32 microversion: 2.1 time: 0.173450 Jul 18 14:24:06.028532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 325/658] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:24:05 2022] POST /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:24:06.038462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.039359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.046900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.047482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.048286 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.048722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.254067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:06.262799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c16f4046-403c-4c6f-825f-f1caf090363b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.228637 Jul 18 14:24:06.263374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 334/659] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:06 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:06.436776 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.438117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.445253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.445817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.446634 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.447222 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.484396 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-11c99a4a-2c31-4a69-a4aa-d182e7b76272 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments/c80dc393-fbad-42ee-b0a9-67c6e3749b69" status: 200 len: 194 microversion: 2.20 time: 0.052219 Jul 18 14:24:06.485560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 326/660] 10.222.0.71 () {60 vars in 1453 bytes} [Mon Jul 18 14:24:06 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments/c80dc393-fbad-42ee-b0a9-67c6e3749b69 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:24:06.558489 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.559018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.565434 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.565952 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.566712 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.567177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.658696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lazy-loading 'services' on Instance uuid c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:24:06.721958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.723573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.731324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.732000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.732892 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.733370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.749590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5226e9d3-aaa5-4bdd-9b16-4e6a4b11c52a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments/c80dc393-fbad-42ee-b0a9-67c6e3749b69" status: 202 len: 0 microversion: 2.20 time: 0.196041 Jul 18 14:24:06.750940 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 335/661] 10.222.0.71 () {60 vars in 1456 bytes} [Mon Jul 18 14:24:06 2022] DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments/c80dc393-fbad-42ee-b0a9-67c6e3749b69 => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:24:06.760232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.761551 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.767227 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ab731520-d997-41e4-9c01-9ffe6dcd3576 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049435 Jul 18 14:24:06.767815 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 327/662] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:06 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:24:06.768553 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.769006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.769839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.770281 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.798191 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:06.803301 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5e7c1877-d92b-4e79-a147-8d5628c7c9e4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047789 Jul 18 14:24:06.803807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 336/663] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 18 14:24:06 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 18 14:24:06.831507 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.832012 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.838871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.839584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.840357 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.840990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.870049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:24:06.959941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33edfe4a-831a-4238-b9fc-56a15284c645 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 204 len: 0 microversion: 2.1 time: 0.132067 Jul 18 14:24:06.960662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 328/664] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:24:06 2022] DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:24:06.969759 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:06.970371 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:06.977205 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.977649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:06.978652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:06.979393 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.158099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:07.168921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6453e31d-38a5-4122-b09e-79886cf302b1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1681 microversion: 2.1 time: 0.203350 Jul 18 14:24:07.169617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 337/665] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:06 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:24:07.281517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:07.282143 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:07.288907 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:07.289356 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.290161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:07.290586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.439594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:07.452179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f8430922-059e-4042-8e74-c3123ad1b28d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.174881 Jul 18 14:24:07.452980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 329/666] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:07 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:07.816587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:07.817546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:07.824676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:07.825141 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.825933 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:07.826363 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:07.857336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3a6b9bc6-131d-4fce-a775-a251d30dcf59 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044721 Jul 18 14:24:07.857918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 338/667] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 18 14:24:07 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:24:08.187318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:08.187944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:08.194752 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.195207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.195976 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.196410 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.343522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:08.351438 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9431aaf7-42f5-498b-a997-808dbd83d0b5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1681 microversion: 2.1 time: 0.168050 Jul 18 14:24:08.352008 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 330/668] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:08 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:08.470621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:08.471361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:08.480177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.480661 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.481857 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.482292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.624948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:08.634366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-799db914-9a83-4128-9bff-f7ef0a9eabab tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.167659 Jul 18 14:24:08.635349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 339/669] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:08 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:08.872949 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:08.873898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:08.880734 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.881190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.882029 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:08.882475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:08.915975 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c80b0e2a-45bf-4c79-814e-edf0baa0f7a9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050013 Jul 18 14:24:08.922077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 331/670] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 18 14:24:08 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:24:09.368590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:09.369333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:09.376946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.377408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.378235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.378667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.610608 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:09.619982 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6966bd4e-5f74-4ecb-b263-dabfa23bd1da tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1681 microversion: 2.1 time: 0.255023 Jul 18 14:24:09.620728 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 340/671] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:09 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1681 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:09.655478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:09.656105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:09.665288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.666197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.667889 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.668695 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.929544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:09.930776 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:09.942144 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.942623 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.943417 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:09.943882 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:09.976234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bf9363cd-89e1-40dd-bf85-ab3822013aa2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050879 Jul 18 14:24:09.976826 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 341/672] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 18 14:24:09 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:24:09.996661 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.005894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-75085a84-27de-4107-b219-22f0e1046687 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.354488 Jul 18 14:24:10.006508 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 332/673] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:09 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:24:10.049797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:10.050298 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:10.057563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.058059 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.058873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.059342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.088617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:24:10.182958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c4c47e4c-e4b0-4c52-b639-2fa03375f13d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 204 len: 0 microversion: 2.20 time: 0.136789 Jul 18 14:24:10.183521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 342/674] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 18 14:24:10 2022] DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:24:10.194872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:10.196166 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:10.202937 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.203395 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.204173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.204612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.447670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.456017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.457505 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.458733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dfbcc87c-14ba-400a-aa2f-1a2a3f5dfb0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.270789 Jul 18 14:24:10.459524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 333/675] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:10 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:10.640265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:10.640969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:10.651388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.651915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.652835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.653362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.853319 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:10.862030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-881696bd-1d1a-4009-8414-73132d9f551a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1613 microversion: 2.1 time: 0.226010 Jul 18 14:24:10.862638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 343/676] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:10 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1613 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:10.938967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-d7a88bd6-c9f4-456b-99c6-cb3fda147649 req-2646bd44-3360-487f-8806-1a250a586e4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da73439b-b34f-42fb-b28a-9fa41604ab3c", "name": "network-vif-deleted", "tag": "869acbfc-dc56-4f1c-9dac-151d00c2f5e8"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:10.949699 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-d7a88bd6-c9f4-456b-99c6-cb3fda147649 req-2646bd44-3360-487f-8806-1a250a586e4d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:10.950156 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-d7a88bd6-c9f4-456b-99c6-cb3fda147649 req-2646bd44-3360-487f-8806-1a250a586e4d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:10.963349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-d7a88bd6-c9f4-456b-99c6-cb3fda147649 req-2646bd44-3360-487f-8806-1a250a586e4d service nova] Creating event network-vif-deleted:869acbfc-dc56-4f1c-9dac-151d00c2f5e8 for instance da73439b-b34f-42fb-b28a-9fa41604ab3c on hv-cinder-79760 Jul 18 14:24:10.968944 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-d7a88bd6-c9f4-456b-99c6-cb3fda147649 req-2646bd44-3360-487f-8806-1a250a586e4d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033826 Jul 18 14:24:10.969590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 334/677] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:11.031773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:11.032411 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:11.039022 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.039471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.040248 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.040895 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.191430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.200229 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c3191b34-d2e6-4397-9803-acd7894286eb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.172967 Jul 18 14:24:11.200862 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 344/678] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:11 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:11.477994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:11.478787 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:11.485935 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.486746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.487583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.488063 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.627673 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.637281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.638945 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.640565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-81009d07-c226-4567-9bd1-ed73d6eeb1a2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.167524 Jul 18 14:24:11.641603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 335/679] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:11 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:11.882269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:11.882971 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:11.894174 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.895629 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.896446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:11.897138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:11.967467 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:11.975239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e87f8e19-b6ca-43a9-b73e-5bccc6378c45 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 200 len: 1613 microversion: 2.1 time: 0.098283 Jul 18 14:24:11.975867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 345/680] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:11 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 1613 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:12.219479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:12.220349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:12.227748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:12.228364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:12.229184 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:12.229610 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:12.394070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.406855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fe17ec54-dcb1-41a5-be72-49f1ec10da6f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.191320 Jul 18 14:24:12.407865 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 336/681] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:12 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:12.660328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:12.660928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:12.668527 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:12.669282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:12.670133 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:12.670568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:12.934551 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.943327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.944841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:12.946064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c5c4cb5d-80ce-43dc-af3a-76223a0e59d2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1724 microversion: 2.20 time: 0.290090 Jul 18 14:24:12.946655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 346/682] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:12 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:12.993457 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:12.993999 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:13.001217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.001675 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.002471 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.002910 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.005761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:13.021078 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c HTTP/1.1 Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:24:13.022943 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:24:13.024461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'da73439b-b34f-42fb-b28a-9fa41604ab3c'} Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:24:13.025290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:24:13.026631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:13.028072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:24:13.028072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5e10080f-48fc-47c3-97f3-34e9df979cfc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 404 len: 111 microversion: 2.1 time: 0.034923 Jul 18 14:24:13.028072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 337/683] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:12 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:24:13.033541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-987b561d-f16d-463e-b2c2-f62781bed4cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '.version_select at 0x7fb53a1913a0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:13.053566 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-987b561d-f16d-463e-b2c2-f62781bed4cd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-529814000" status: 202 len: 0 microversion: 2.1 time: 0.023751 Jul 18 14:24:13.054403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 347/684] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 18 14:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-529814000 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:24:13.425141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:13.425756 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:13.433355 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.434072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.435028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.435664 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.461058 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-4978be85-7898-4630-a1cb-5bdcd74a97f5 req-f8b89698-7aaf-4d70-9a54-29930519e266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6", "name": "network-vif-deleted", "tag": "19ce03bb-4821-493d-a735-9df172790922"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:13.471042 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4978be85-7898-4630-a1cb-5bdcd74a97f5 req-f8b89698-7aaf-4d70-9a54-29930519e266 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.471478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4978be85-7898-4630-a1cb-5bdcd74a97f5 req-f8b89698-7aaf-4d70-9a54-29930519e266 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.485431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-4978be85-7898-4630-a1cb-5bdcd74a97f5 req-f8b89698-7aaf-4d70-9a54-29930519e266 service nova] Creating event network-vif-deleted:19ce03bb-4821-493d-a735-9df172790922 for instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 on hv-cinder-79760 Jul 18 14:24:13.491335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-4978be85-7898-4630-a1cb-5bdcd74a97f5 req-f8b89698-7aaf-4d70-9a54-29930519e266 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033926 Jul 18 14:24:13.492652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 348/685] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:13.658613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:13.670838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-11cfdb52-0e11-4a32-90e0-c542daa08aa9 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.249883 Jul 18 14:24:13.672106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 338/686] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:13 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:13.902305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-174ab889-be3c-4b67-8fac-97dbaf7e076a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: .version_select at 0x7fb53a2173a0>, body: {"keypair": {"name": "tempest-keypair-1182769256", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIB36aS9beMqEEjmtojlNPTfsIa5h2WjWjgdEg92rSnfYKzrEo3Uo2Ie49mU4OXd1hnU40fhoUtU96qyNYAcjSua8nvTIh0tBSl7dRkyeXVuwEZo4+9JTcvr8f2zt6bfqQ=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:13.917336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-174ab889-be3c-4b67-8fac-97dbaf7e076a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:24:13.921382 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-174ab889-be3c-4b67-8fac-97dbaf7e076a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:24:13.955454 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-174ab889-be3c-4b67-8fac-97dbaf7e076a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058244 Jul 18 14:24:13.956136 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 349/687] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:24:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:13.969746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:13.970603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:13.979685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.980142 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:13.980941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:13.981474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:14.032056 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:14.033910 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:14.034549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lazy-loading 'fault' on Instance uuid c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:24:14.110851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:14.120100 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:14.122749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:14.124371 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b1ba9706-2ff0-4ad0-a3aa-f5804c1f09a4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 200 len: 1371 microversion: 2.20 time: 0.163846 Jul 18 14:24:14.125475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 339/688] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:13 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:14.689449 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:14.691403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:14.699515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:14.700417 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:14.701373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:14.702121 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:14.853108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:14.863000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-927f2757-5d75-4d55-b17f-8dd4dd61b8cf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.178240 Jul 18 14:24:14.863592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 350/689] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:14 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:15.144432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:15.145145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:15.152694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:15.153161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:15.154015 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:15.154464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:15.169451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] HTTP exception thrown: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Request method failure captured: Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 HTTP/1.1 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvlwkoBn5cIKJEh9xfxHbGCTik4qtRUcyvu5k_QVwGr2rWhifEpow0CJ1F5yyPJxzGkeWfX4Atl5OI2USrnK_RNCTuc7NIjd1Rv7iXPKvS7W4m3fhKeCQIULVDQf7aQYYDASxZs4cL9lUSq-PsdO2BH97sFl5RvAo7jlVvsgvlGZd8 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:24:15.171071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e6a24dfb85b04adfa565f06fde95d6b6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 3aab24bab8d74b7aa5a20e7b2b89b5d7 Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:24:15.172427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6'} Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:24:15.173159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:24:15.174351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:15.175373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Returning 404 to user: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:24:15.175373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-86aedf0a-b7d7-4cf5-8497-e9e90ffa8007 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 404 len: 111 microversion: 2.20 time: 0.032198 Jul 18 14:24:15.175373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 340/690] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:15 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:24:15.182195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d3090f00-4ed7-41ae-98fb-85581ddcc0d9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '.version_select at 0x7fb53a18cdc0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:15.203841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d3090f00-4ed7-41ae-98fb-85581ddcc0d9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091530357" status: 204 len: 0 microversion: 2.20 time: 0.025938 Jul 18 14:24:15.204427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 351/691] 10.222.0.71 () {60 vars in 1261 bytes} [Mon Jul 18 14:24:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2091530357 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:24:15.698184 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-75722605", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c89027a-566a-4914-8ad9-bb014d7b4afd"}], "security_groups": [{"name": "tempest-securitygroup--1705021976"}], "key_name": "tempest-keypair-1182769256", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:15.850196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] validate_networks() for [('6c89027a-566a-4914-8ad9-bb014d7b4afd', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:24:15.880654 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:15.881226 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:15.888613 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:15.889061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:15.889885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:15.890325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:16.122631 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:16.131700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a3822985-b70f-4121-902a-b581fc19ca0e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.254733 Jul 18 14:24:16.132392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 352/692] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:15 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:16.137931 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fb8013f4-d802-47d3-9711-53effed5dd87 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'create', calling method: .version_select at 0x7fb53a0d8790>, body: {"keypair": {"name": "tempest-keypair-1120188041", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGIG68veHK6eRTvASaRoInsuwKKPbYG5oD4RvK63/F0I3eDzM83asuCLMXEqSR9Ksqe6Gqvrdm6bXoSLU1nPMRElGK8uiF6l4sM/sFADiRr6rYAuSI+gORD6kPoB0ed6zw=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:16.142426 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:16.157092 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fb8013f4-d802-47d3-9711-53effed5dd87 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:24:16.162562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fb8013f4-d802-47d3-9711-53effed5dd87 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for user 3aab24bab8d74b7aa5a20e7b2b89b5d7 and project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:24:16.189021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fb8013f4-d802-47d3-9711-53effed5dd87 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.055423 Jul 18 14:24:16.194935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 353/693] 10.222.0.71 () {62 vars in 1199 bytes} [Mon Jul 18 14:24:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 18 14:24:16.395996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:24:16.396514 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:24:16.396899 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:24:16.397306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:24:16.397720 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:24:16.407861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:16.408290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:16.409150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:16.409590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:16.428880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:24:16.433753 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:24:16.445013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:24:16.447766 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:24:16.498331 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ede31b10-c42b-4526-b2ce-0fbe5549e8a3 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.804876 Jul 18 14:24:16.499367 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 341/694] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:24:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:24:16.509416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ab378f5d-c399-44ab-b0d7-dfef3a5dea99 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:16.510272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ab378f5d-c399-44ab-b0d7-dfef3a5dea99 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:16.577344 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ab378f5d-c399-44ab-b0d7-dfef3a5dea99 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:16.605428 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ab378f5d-c399-44ab-b0d7-dfef3a5dea99 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1240 microversion: 2.1 time: 0.099864 Jul 18 14:24:16.606361 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 354/695] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:16 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1240 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:17.149741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:17.150755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:17.158480 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:17.159164 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:17.159957 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:17.160418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:17.381905 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:17.391418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ccddc932-f1b0-47e3-b3fe-0ddb703cac8d tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.245651 Jul 18 14:24:17.392010 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 342/696] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:17 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:17.623384 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:17.624199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:17.641564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:17.642107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:17.643253 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:17.643512 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:17.742214 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:17.750507 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b678443f-0312-454a-a1bc-f9b840cc5095 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1310 microversion: 2.1 time: 0.131361 Jul 18 14:24:17.751064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 355/697] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:17 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1310 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:17.917123 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-798051515", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "cb202500-3bef-40aa-b87d-ae6d50c664ee"}], "security_groups": [{"name": "tempest-securitygroup--2130602195"}], "key_name": "tempest-keypair-1120188041", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:18.047817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] validate_networks() for [('cb202500-3bef-40aa-b87d-ae6d50c664ee', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:24:18.408580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:18.409291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:18.415673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:18.416252 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:18.417198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:18.417632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:18.985861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:18.994905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-77d2939d-4bab-4544-8519-0cbe091fc4b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.590054 Jul 18 14:24:18.995416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 356/698] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:18 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:18.999982 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:19.000734 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:19.007125 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:19.007581 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:19.008353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:19.008790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:19.025118 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:19.042830 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:24:19.043472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:24:19.044510 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:24:19.045162 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:24:19.046014 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:24:19.060599 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:19.061355 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:19.062982 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:19.063703 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:19.088218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:24:19.088507 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Mon Jul 18 14:24:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.71) !!! Jul 18 14:24:19.095862 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:24:19.102188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Getting quotas for user 3aab24bab8d74b7aa5a20e7b2b89b5d7 and project e6a24dfb85b04adfa565f06fde95d6b6. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:24:19.120262 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:24:19.122380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:24:19.182637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-24939eeb-f467-4b37-8e3f-4fec58636a56 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.328708 Jul 18 14:24:19.184255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 343/699] 10.222.0.71 () {62 vars in 1187 bytes} [Mon Jul 18 14:24:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 1331 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 18 14:24:19.194895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-913d04bf-5d6a-4b52-b9cd-0d1a2a10ee71 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:19.195876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-913d04bf-5d6a-4b52-b9cd-0d1a2a10ee71 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:19.279189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-913d04bf-5d6a-4b52-b9cd-0d1a2a10ee71 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:19.285365 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:19.289673 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-913d04bf-5d6a-4b52-b9cd-0d1a2a10ee71 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:19.291586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-913d04bf-5d6a-4b52-b9cd-0d1a2a10ee71 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:19.293145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-913d04bf-5d6a-4b52-b9cd-0d1a2a10ee71 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1281 microversion: 2.20 time: 0.102475 Jul 18 14:24:19.297491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8ae26db8-adda-4958-953d-29578a2a2dcf tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.300795 Jul 18 14:24:19.298081 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 357/700] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:18 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:19.298562 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 344/701] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:19 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1281 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:24:20.015487 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:20.016495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:20.031958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.031958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.031958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.032912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.043636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-2685e693-45af-4a23-9736-bca1a2103120 req-59091643-9d7f-4de2-ab33-e3d7345edfde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf", "tag": "8dcf14fa-66e1-4d28-bf09-6e39927373f4"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:20.066950 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2685e693-45af-4a23-9736-bca1a2103120 req-59091643-9d7f-4de2-ab33-e3d7345edfde service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.067387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2685e693-45af-4a23-9736-bca1a2103120 req-59091643-9d7f-4de2-ab33-e3d7345edfde service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.080945 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-2685e693-45af-4a23-9736-bca1a2103120 req-59091643-9d7f-4de2-ab33-e3d7345edfde service nova] Creating event network-changed:8dcf14fa-66e1-4d28-bf09-6e39927373f4 for instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf on hv-cinder-79760 Jul 18 14:24:20.091307 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-2685e693-45af-4a23-9736-bca1a2103120 req-59091643-9d7f-4de2-ab33-e3d7345edfde service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052825 Jul 18 14:24:20.092240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 345/702] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:20.195041 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:20.205263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c2776053-2970-4bc3-af1f-2ae737de6fc2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.196384 Jul 18 14:24:20.206238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 358/703] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:20 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:24:20.324293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:20.325237 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:20.327082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:20.330055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:20.345482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.347993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.351075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.362017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.362301 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.362301 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.362301 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:20.362301 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:20.502711 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:20.514638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:20.516454 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:20.517832 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-82282fb7-a0fb-4844-9a70-890f3797d9b2 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1351 microversion: 2.20 time: 0.200339 Jul 18 14:24:20.518894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 359/704] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:20 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1351 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:20.643550 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:20.651715 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-68f3f3f8-7bac-4fbc-923f-36da3a210e1c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.339123 Jul 18 14:24:20.661290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 346/705] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:20 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:21.223660 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:21.224416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:21.231494 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.232035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.232914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.233568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.370303 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:21.378761 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0de9e7a0-ae93-4082-8d8a-208fe0ce578c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.158944 Jul 18 14:24:21.379449 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 360/706] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:21 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:21.537024 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:21.538413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:21.550416 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.551119 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.552017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.552560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.706008 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:21.714421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:21.716047 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:21.717268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-97f92dd0-5b71-4576-9fb8-5f1d67d88d9a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.184308 Jul 18 14:24:21.718130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 347/707] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:21 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:21.743626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:21.744770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:21.750853 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.751294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.752420 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.752865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.760195 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-7569ed12-c14a-4926-b916-774601f04467 req-9c4d622f-c85f-4aa3-99e1-0c4ef603ec68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:21.777985 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7569ed12-c14a-4926-b916-774601f04467 req-9c4d622f-c85f-4aa3-99e1-0c4ef603ec68 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:21.778716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-7569ed12-c14a-4926-b916-774601f04467 req-9c4d622f-c85f-4aa3-99e1-0c4ef603ec68 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:21.798784 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-7569ed12-c14a-4926-b916-774601f04467 req-9c4d622f-c85f-4aa3-99e1-0c4ef603ec68 service nova] Creating event network-changed:ecacf148-6e72-4653-b111-eaa9fa31984d for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b on hv-cinder-79760 Jul 18 14:24:21.803861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-7569ed12-c14a-4926-b916-774601f04467 req-9c4d622f-c85f-4aa3-99e1-0c4ef603ec68 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050037 Jul 18 14:24:21.804461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 348/708] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:21.901103 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:21.908843 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7c9b3221-a967-4f88-9267-e8ee779d21ea tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.243767 Jul 18 14:24:21.909424 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 361/709] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:21 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:24:22.396866 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:22.397583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:22.404347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:22.405074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:22.406084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:22.406680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:22.545533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:22.553509 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2a326286-2f9f-408f-801f-aa232b5cf1d5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.160874 Jul 18 14:24:22.554100 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 349/710] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:22 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:22.736814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:22.737691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:22.745049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:22.745490 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:22.746286 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:22.746713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:22.905394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:22.914009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:22.915502 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:22.917336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e52bcee2-0141-43eb-b998-33a6f85a02bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.185016 Jul 18 14:24:22.917951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 362/711] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:22 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:22.926945 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:22.927553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:22.935204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:22.935652 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:22.936423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:22.936857 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:23.082058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:23.091670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-678cc7cd-ff2f-4b7b-b91e-81e9fb6b8a13 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.168601 Jul 18 14:24:23.097876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 350/712] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:22 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:23.469147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:24:23.469427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:24:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:24:23.575546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:23.576145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:23.584739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:23.585375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:23.588086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:23.588542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:23.783054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:23.793545 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-67288919-4bad-432c-88d0-8719f3277dff tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.222238 Jul 18 14:24:23.794151 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 363/713] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:23 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:23.936743 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:23.937319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:23.947114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:23.947710 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:23.948541 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:23.949016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:24.111610 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:24.114641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:24.115502 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:24.122518 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:24.122962 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:24.123560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:24.123770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:24.124147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:24.125095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:24.126685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-880673a0-542f-4235-aa24-b653c1280dbe tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.194502 Jul 18 14:24:24.127547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 351/714] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:23 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:24.264459 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:24.275323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d01e0e1e-860e-437d-b172-9d04c94b3745 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.163388 Jul 18 14:24:24.276618 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 364/715] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:24 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:24.811544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:24.812160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:24.814304 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:24.820180 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:24.820616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:24.821545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:24.822043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:24.964703 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:24.975048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e282af3e-878d-4406-9d6c-f4a6dfdd10fe tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1734 microversion: 2.1 time: 0.167428 Jul 18 14:24:24.975625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 352/716] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:24 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:25.147786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:25.148355 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:25.155935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:25.156358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:25.157191 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:25.157605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:25.297520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:25.300645 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:25.301231 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:25.308265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:25.308726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:25.309514 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:25.309994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:25.310277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:25.311824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:25.313322 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-dd79b9c3-9868-420d-b96f-f00712d6a7bc tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.169638 Jul 18 14:24:25.314788 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 365/717] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:25 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:25.464134 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:25.472068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a7a7a381-cef0-4bd1-b5f4-2a1d45607aa5 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.175218 Jul 18 14:24:25.472654 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 353/718] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:25 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:25.993437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:25.994101 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:26.000708 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.001164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.001964 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.002406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.156201 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:26.164891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-58c9c094-9468-4d26-8fc9-1a714411b935 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1714 microversion: 2.1 time: 0.175547 Jul 18 14:24:26.165483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 366/719] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:25 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1714 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:26.225256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:26.225823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:26.232861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.233306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.234120 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.234549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.325842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] HTTP exception thrown: Cannot 'detach_volume' instance 01d05706-af03-4d2d-9a35-219ad3d890fd while it is in vm_state rescued Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Request method failure captured: Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments/736c40c7-6d40-469a-8fd5-f8eb767612ef HTTP/1.1 Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvqT-vMuaaccIbC9_d9fh0zgzEeFdGY0u6NXMWx0l2Uebt77StaetXx51TnLsBNIos7d85_Y2rC9J6HE5xJO8mTOeTP_8mJRjF9v0cXZCZ7nGdI4ff8IHrAZ_3NhVBwts4qNbPleLh4-G9N74qPZe5NrSSEx7tK7W0liRixYb4CLsY Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:24:26.327419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_38cf167c2fc74ac09d6f6d6f81829cda", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 8a45cafadb824e08bd9e86fd0d5c4c71 Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:24:26.328779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Cannot 'detach_volume' instance 01d05706-af03-4d2d-9a35-219ad3d890fd while it is in vm_state rescued Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'server_id': '01d05706-af03-4d2d-9a35-219ad3d890fd', 'id': '736c40c7-6d40-469a-8fd5-f8eb767612ef'} Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:24:26.329491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 01d05706-af03-4d2d-9a35-219ad3d890fd while it is in vm_state rescued Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 01d05706-af03-4d2d-9a35-219ad3d890fd while it is in vm_state rescued Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:24:26.330761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Returning 409 to user: Cannot 'detach_volume' instance 01d05706-af03-4d2d-9a35-219ad3d890fd while it is in vm_state rescued {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:24:26.331829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9e2eb82f-cfcd-4085-b1df-7de835794dd2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments/736c40c7-6d40-469a-8fd5-f8eb767612ef" status: 409 len: 152 microversion: 2.1 time: 0.107877 Jul 18 14:24:26.331829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 354/720] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:24:26 2022] DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments/736c40c7-6d40-469a-8fd5-f8eb767612ef => generated 152 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 18 14:24:26.333167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:26.333870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:26.338109 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:26.338669 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:26.340885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.341340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.342162 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.342614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.345058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.345519 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.346317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.346753 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.419279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5f4700e6-a660-40e1-af33-63475769290e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "POST /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/action" status: 202 len: 0 microversion: 2.1 time: 0.084940 Jul 18 14:24:26.423685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 355/721] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:24:26 2022] POST /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:24:26.432433 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:26.433139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:26.440852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.441392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.442210 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.442648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.507282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:26.518873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:26.521710 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:26.523158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cf260298-bf7e-4189-89e3-c5662748ede6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.194312 Jul 18 14:24:26.523808 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 367/722] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:26 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:26.528815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:26.529636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:26.536568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.537249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.538251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.538678 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:26.604604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=10 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:26.661244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:26.678605 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7fdb9b1d-ebfb-4cd6-b990-50311d369b3c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1722 microversion: 2.1 time: 0.252423 Jul 18 14:24:26.680388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 356/723] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:26 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:26.713729 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:26.722498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7da6bb44-9547-4bba-9537-a00095f59433 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.197575 Jul 18 14:24:26.723487 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 368/724] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:26 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:26.980958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-e3aec40f-cfec-4f37-9bdb-b95ad88823fc req-4bcd3b58-e089-4372-8d4e-e87db792435c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf", "name": "network-vif-plugged", "status": "completed", "tag": "8dcf14fa-66e1-4d28-bf09-6e39927373f4"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:26.990408 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e3aec40f-cfec-4f37-9bdb-b95ad88823fc req-4bcd3b58-e089-4372-8d4e-e87db792435c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:26.990905 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e3aec40f-cfec-4f37-9bdb-b95ad88823fc req-4bcd3b58-e089-4372-8d4e-e87db792435c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.005698 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-e3aec40f-cfec-4f37-9bdb-b95ad88823fc req-4bcd3b58-e089-4372-8d4e-e87db792435c service nova] Creating event network-vif-plugged:8dcf14fa-66e1-4d28-bf09-6e39927373f4 for instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf on hv-cinder-79760 Jul 18 14:24:27.011067 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-e3aec40f-cfec-4f37-9bdb-b95ad88823fc req-4bcd3b58-e089-4372-8d4e-e87db792435c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034031 Jul 18 14:24:27.012654 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 357/725] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:27.541822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:27.542482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:27.549917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:27.550317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.551098 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:27.551531 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.699544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:27.700313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:27.706397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:27.707026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:27.707492 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.708374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:27.708809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.713087 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:27.715536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:27.717158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:27.718363 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3762584a-8ca2-4bb3-a630-2f52d3cb531f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.180771 Jul 18 14:24:27.718952 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 369/726] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:27 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:27.740243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:27.740848 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:27.747316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:27.747765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.748548 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:27.748984 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:27.896781 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:27.905693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cff72df3-d58b-4d41-b957-18f2d55b8393 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1722 microversion: 2.1 time: 0.211148 Jul 18 14:24:27.906284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 358/727] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:27 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:27.938621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:27.949326 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bd24c78c-91ab-41d7-b721-502bd43c8907 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.212917 Jul 18 14:24:27.950338 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 370/728] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:27 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:28.737132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:28.737800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:28.744494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:28.744950 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:28.745756 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:28.746200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:28.887797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:28.896451 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:28.897989 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:28.899119 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b954cf10-66c5-410e-8a8a-a8260242dc4d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.166426 Jul 18 14:24:28.899704 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 359/729] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:28 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:28.927369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:28.927973 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:28.938371 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:28.938821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:28.939998 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:28.940605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:28.967621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:28.968275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:28.974677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:28.975132 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:28.975906 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:28.976342 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:29.075874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:29.141297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:29.149293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d868692e-39cb-4b04-938e-5c9a4cc7529b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1722 microversion: 2.1 time: 0.228465 Jul 18 14:24:29.149886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 371/730] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:28 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1722 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:29.154413 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-0ff13457-5b93-4faf-a8c9-52bd47f514aa req-ecb989db-0b64-4313-9bcc-ee7d3c961491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "name": "network-vif-plugged", "status": "completed", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:29.162714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-0ff13457-5b93-4faf-a8c9-52bd47f514aa req-ecb989db-0b64-4313-9bcc-ee7d3c961491 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:29.163142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-0ff13457-5b93-4faf-a8c9-52bd47f514aa req-ecb989db-0b64-4313-9bcc-ee7d3c961491 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:29.164485 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:29.172462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-44830868-29c6-416c-a02b-3e1f28b467e9 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.209352 Jul 18 14:24:29.173028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 360/731] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:28 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:29.175186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-0ff13457-5b93-4faf-a8c9-52bd47f514aa req-ecb989db-0b64-4313-9bcc-ee7d3c961491 service nova] Creating event network-vif-plugged:ecacf148-6e72-4653-b111-eaa9fa31984d for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b on hv-cinder-79760 Jul 18 14:24:29.180541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-0ff13457-5b93-4faf-a8c9-52bd47f514aa req-ecb989db-0b64-4313-9bcc-ee7d3c961491 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029501 Jul 18 14:24:29.181183 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 372/732] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:29.926288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:29.926899 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:29.929563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=14 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:29.936618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:29.937076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:29.937899 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:29.938453 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.087308 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:30.095834 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:30.097334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:30.098487 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d1e933ad-1cc3-4eef-a1a9-dd78df44ba74 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.178178 Jul 18 14:24:30.099022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 361/733] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:29 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:30.168686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:30.169407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:30.176773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:30.177246 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.178041 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:30.178468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.190058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:30.190690 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:30.196942 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:30.197473 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.198203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:30.198616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.383941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:30.403381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-65050809-c21c-4dc1-b27c-0a900f18d29f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1728 microversion: 2.1 time: 0.239527 Jul 18 14:24:30.403617 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:30.403972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 373/734] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:30 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1728 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:30.413179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-823bdca1-9775-463c-a944-3cf9119b49c1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1366 microversion: 2.1 time: 0.226796 Jul 18 14:24:30.422780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 362/735] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:30 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:30.423036 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:30.423036 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:30.429839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:30.430520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.431408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:30.431842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:30.519030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-992e17fc-d4a9-4453-afe6-c33cab4a97a3 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102103 Jul 18 14:24:30.519623 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 374/736] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:24:30 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:31.117088 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:31.117723 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:31.124666 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.125116 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.125951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.126380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.431471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:31.432081 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:31.439762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.440221 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.440985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.441412 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.444343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=100 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:31.694127 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:31.703522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:31.704518 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:31.705050 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:31.706916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0d2993a9-19bf-480a-82da-711873b697ff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1407 microversion: 2.20 time: 0.593272 Jul 18 14:24:31.707864 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 363/737] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:31 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1407 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:31.714411 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-26308631-0f6c-4538-8a16-122e8848130a tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1555 microversion: 2.1 time: 0.287548 Jul 18 14:24:31.715311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 375/738] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:31 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1555 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:31.736379 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:31.736696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:31.743294 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.743741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.744510 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.744936 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.868305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1eecce89-0bcb-40f4-901b-8a10acc446d6 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.136498 Jul 18 14:24:31.869002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 364/739] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:24:31 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-interface => generated 284 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:31.938335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-6cff0beb-1b94-4b97-b885-1742e7088c86 req-e0111255-de5c-43e0-9b3b-ee2c0547ffd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d05706-af03-4d2d-9a35-219ad3d890fd", "tag": "20e66e05-7f29-4c65-9267-fa171a53da05"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:31.948913 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6cff0beb-1b94-4b97-b885-1742e7088c86 req-e0111255-de5c-43e0-9b3b-ee2c0547ffd7 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:31.949879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6cff0beb-1b94-4b97-b885-1742e7088c86 req-e0111255-de5c-43e0-9b3b-ee2c0547ffd7 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:31.973568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-6cff0beb-1b94-4b97-b885-1742e7088c86 req-e0111255-de5c-43e0-9b3b-ee2c0547ffd7 service nova] Creating event network-changed:20e66e05-7f29-4c65-9267-fa171a53da05 for instance 01d05706-af03-4d2d-9a35-219ad3d890fd on hv-cinder-79760 Jul 18 14:24:31.979374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-6cff0beb-1b94-4b97-b885-1742e7088c86 req-e0111255-de5c-43e0-9b3b-ee2c0547ffd7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047269 Jul 18 14:24:31.979988 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 376/740] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:32.726356 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:32.726990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:32.734148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:32.734608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:32.735432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:32.735876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:32.881805 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:32.891022 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:32.892604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:32.893923 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-df88c3ad-d62e-42a1-a021-2ab841b4ff88 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1599 microversion: 2.20 time: 0.173081 Jul 18 14:24:32.894756 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 365/741] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:24:32 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1599 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:24:32.916869 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:32.917506 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:32.924878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:32.925403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:32.926369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:32.926793 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:33.007641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e14f5167-c540-4410-81a5-3e5b3672549a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.096127 Jul 18 14:24:33.008375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 377/742] 10.222.0.71 () {60 vars in 1315 bytes} [Mon Jul 18 14:24:32 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:24:33.266497 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-e52ecfcf-e10e-4ac5-8c71-7c42b789374c req-fcc428b4-bacd-44c5-945f-c5648c8ef628 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf", "tag": "8dcf14fa-66e1-4d28-bf09-6e39927373f4"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:33.275183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e52ecfcf-e10e-4ac5-8c71-7c42b789374c req-fcc428b4-bacd-44c5-945f-c5648c8ef628 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:33.275782 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e52ecfcf-e10e-4ac5-8c71-7c42b789374c req-fcc428b4-bacd-44c5-945f-c5648c8ef628 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:33.298080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-e52ecfcf-e10e-4ac5-8c71-7c42b789374c req-fcc428b4-bacd-44c5-945f-c5648c8ef628 service nova] Creating event network-changed:8dcf14fa-66e1-4d28-bf09-6e39927373f4 for instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf on hv-cinder-79760 Jul 18 14:24:33.303978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-e52ecfcf-e10e-4ac5-8c71-7c42b789374c req-fcc428b4-bacd-44c5-945f-c5648c8ef628 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041236 Jul 18 14:24:33.305136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 366/743] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:34.029678 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-153c703e-749d-447b-8384-1d65963ed947 req-df3d7872-9abe-4de9-8928-9a214fdab9f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01d05706-af03-4d2d-9a35-219ad3d890fd", "tag": "20e66e05-7f29-4c65-9267-fa171a53da05"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:34.038365 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-153c703e-749d-447b-8384-1d65963ed947 req-df3d7872-9abe-4de9-8928-9a214fdab9f1 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:34.039623 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-153c703e-749d-447b-8384-1d65963ed947 req-df3d7872-9abe-4de9-8928-9a214fdab9f1 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:34.051483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-153c703e-749d-447b-8384-1d65963ed947 req-df3d7872-9abe-4de9-8928-9a214fdab9f1 service nova] Creating event network-changed:20e66e05-7f29-4c65-9267-fa171a53da05 for instance 01d05706-af03-4d2d-9a35-219ad3d890fd on hv-cinder-79760 Jul 18 14:24:34.056872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-153c703e-749d-447b-8384-1d65963ed947 req-df3d7872-9abe-4de9-8928-9a214fdab9f1 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032635 Jul 18 14:24:34.057650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 378/744] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:36.089047 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-5427108d-2541-4bbf-85ff-8990a422549c req-279b51ff-6409-432a-a5df-6f4adf2877be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:36.097761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5427108d-2541-4bbf-85ff-8990a422549c req-279b51ff-6409-432a-a5df-6f4adf2877be service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:36.098206 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5427108d-2541-4bbf-85ff-8990a422549c req-279b51ff-6409-432a-a5df-6f4adf2877be service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:36.109780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-5427108d-2541-4bbf-85ff-8990a422549c req-279b51ff-6409-432a-a5df-6f4adf2877be service nova] Creating event network-changed:ecacf148-6e72-4653-b111-eaa9fa31984d for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b on hv-cinder-79760 Jul 18 14:24:36.115300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-5427108d-2541-4bbf-85ff-8990a422549c req-279b51ff-6409-432a-a5df-6f4adf2877be service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031469 Jul 18 14:24:36.115893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 367/745] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:39.329327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-232535906"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:39.330052 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:39.338113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.338579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.339358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.339790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.482436 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.network.security_group_api [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Removing security group 182e9aae-33dc-40a0-93a2-28bb5168dc58 from port 18a33129-897d-4e1f-8fb9-17adcd5c0b2d Jul 18 14:24:39.865291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-186a60b2-1444-4a82-8708-75ee1ef3f461 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/action" status: 202 len: 0 microversion: 2.1 time: 0.540543 Jul 18 14:24:39.869514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 379/746] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:24:39 2022] POST /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:24:39.888655 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-cad45ad0-f40c-4889-8a08-6d44e60d4fef req-87dedf70-8b05-41e7-9d65-6b84cd2a60fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:39.911231 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-cad45ad0-f40c-4889-8a08-6d44e60d4fef req-87dedf70-8b05-41e7-9d65-6b84cd2a60fc service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:39.912919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-cad45ad0-f40c-4889-8a08-6d44e60d4fef req-87dedf70-8b05-41e7-9d65-6b84cd2a60fc service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:39.930049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-cad45ad0-f40c-4889-8a08-6d44e60d4fef req-87dedf70-8b05-41e7-9d65-6b84cd2a60fc service nova] Creating event network-changed:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:24:39.936259 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-cad45ad0-f40c-4889-8a08-6d44e60d4fef req-87dedf70-8b05-41e7-9d65-6b84cd2a60fc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066247 Jul 18 14:24:39.937939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 368/747] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:41.412694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:41.413209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:41.419672 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:41.420192 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:41.421021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:41.421515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:41.514850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lazy-loading 'services' on Instance uuid c86f5812-485f-4bde-874d-3ab5475b099d {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:24:41.592907 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5c5dab6f-22e1-4483-905b-720d1dddfc89 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments/55dcac24-de6a-4387-9acc-f7c699daae68" status: 202 len: 0 microversion: 2.1 time: 0.184601 Jul 18 14:24:41.593900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 380/748] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:24:41 2022] DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments/55dcac24-de6a-4387-9acc-f7c699daae68 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:24:41.604256 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:41.605135 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:41.612616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:41.613055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:41.613873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:41.614316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:41.658615 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-96e94811-f3a2-4f49-ab3d-76f7c871f048 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059401 Jul 18 14:24:41.659405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 369/749] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:41 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:24:41.953841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-c5215322-0c75-4c1d-9891-602c98b02dba req-7c70acf9-319e-4fe0-84c6-fa48ae265dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:41.962720 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c5215322-0c75-4c1d-9891-602c98b02dba req-7c70acf9-319e-4fe0-84c6-fa48ae265dc2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:41.963162 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-c5215322-0c75-4c1d-9891-602c98b02dba req-7c70acf9-319e-4fe0-84c6-fa48ae265dc2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:41.974803 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-c5215322-0c75-4c1d-9891-602c98b02dba req-7c70acf9-319e-4fe0-84c6-fa48ae265dc2 service nova] Creating event network-changed:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:24:41.980686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-c5215322-0c75-4c1d-9891-602c98b02dba req-7c70acf9-319e-4fe0-84c6-fa48ae265dc2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030849 Jul 18 14:24:41.981308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 381/750] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:42.670977 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:42.671910 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:42.678696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:42.679152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:42.680205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:42.680641 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:42.711727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d24cfb96-6ae3-4a9a-a835-f5cddc3962a3 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044685 Jul 18 14:24:42.712200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 370/751] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:24:42 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:24:42.723988 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:42.724609 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:42.730816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:42.731250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:42.732003 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:42.732424 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:42.811268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] HTTP exception thrown: Instance c86f5812-485f-4bde-874d-3ab5475b099d is not attached to volume 55dcac24-de6a-4387-9acc-f7c699daae68 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Request method failure captured: Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments/55dcac24-de6a-4387-9acc-f7c699daae68 HTTP/1.1 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WxeGGN3Bgz0DYZiQ_wkIx4cqApFkwt3nYYLfRvpVgTcJTkkl0eGniRioPiO6jHxM5Be0Ik-n7LNpErBR_Uz0EQR_pEY-Wf55Ec7znhOgJ8wOrsDDAZ7vFrkXzj_X8OeOhGXm65eHhkeT6YKf9NxwiXwvm7OvPwxGvwSl_zo-5DxeJQ Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: af54954fbeeb4772ad57290fceb3b177 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestMinimumBasicScenario-289253531 Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:24:42.814291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/af54954fbeeb4772ad57290fceb3b177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/af54954fbeeb4772ad57290fceb3b177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/af54954fbeeb4772ad57290fceb3b177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_af54954fbeeb4772ad57290fceb3b177", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestMinimumBasicScenario-289253531 Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: af54954fbeeb4772ad57290fceb3b177 Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestMinimumBasicScenario-289253531 Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-TestMinimumBasicScenario-289253531-project Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a9057278ae1c42a5a2802a3be11828df Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestMinimumBasicScenario-289253531-project Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:24:42.815885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance c86f5812-485f-4bde-874d-3ab5475b099d is not attached to volume 55dcac24-de6a-4387-9acc-f7c699daae68 Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'server_id': 'c86f5812-485f-4bde-874d-3ab5475b099d', 'id': '55dcac24-de6a-4387-9acc-f7c699daae68'} Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 55dcac24-de6a-4387-9acc-f7c699daae68. Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:24:42.817040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86f5812-485f-4bde-874d-3ab5475b099d is not attached to volume 55dcac24-de6a-4387-9acc-f7c699daae68 Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86f5812-485f-4bde-874d-3ab5475b099d is not attached to volume 55dcac24-de6a-4387-9acc-f7c699daae68 Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:42.818924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Returning 404 to user: Instance c86f5812-485f-4bde-874d-3ab5475b099d is not attached to volume 55dcac24-de6a-4387-9acc-f7c699daae68 {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:24:42.820541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c3aa42d2-e78f-47ae-8162-48140f338d1c tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments/55dcac24-de6a-4387-9acc-f7c699daae68" status: 404 len: 154 microversion: 2.1 time: 0.096743 Jul 18 14:24:42.820541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 382/752] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:24:42 2022] DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d/os-volume_attachments/55dcac24-de6a-4387-9acc-f7c699daae68 => generated 154 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:24:43.980327 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:43.980900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:43.988744 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:43.989222 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:43.990040 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:43.990493 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:44.016713 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:24:44.095884 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-613017ff-2ca5-4482-b618-a583d60d9b2f tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 204 len: 0 microversion: 2.1 time: 0.119222 Jul 18 14:24:44.096691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 371/753] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:24:43 2022] DELETE /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:24:44.105730 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:44.106522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:44.113633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:44.114239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:44.115006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:44.115441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:44.280563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:44.289979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-01eb79f9-40d0-4cb6-aecd-e602dee96b9a tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1554 microversion: 2.1 time: 0.188556 Jul 18 14:24:44.290558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 383/754] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:44 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1554 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:45.308997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:45.309680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:45.316969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:45.317421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:45.318253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:45.318690 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:45.467177 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:45.476392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3cd436f1-e581-4e6b-8d20-8baa5e1194d8 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1554 microversion: 2.1 time: 0.171672 Jul 18 14:24:45.477062 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 372/755] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:45 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1554 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:46.495600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:46.496195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:46.499760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:24:46.505483 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:46.505964 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:46.506746 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:46.507176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:46.663731 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a9057278ae1c42a5a2802a3be11828df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af54954fbeeb4772ad57290fceb3b177', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:24:46.678332 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9e75ca4f-37ae-44d5-82ef-5b2d246b21fd tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 200 len: 1554 microversion: 2.1 time: 0.186733 Jul 18 14:24:46.678935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 384/756] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:46 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:24:47.046426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-06b0ed72-06e2-4d59-bc35-4340dde39435 req-ec466c41-882f-425c-87fc-584249fdfd54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c86f5812-485f-4bde-874d-3ab5475b099d", "name": "network-vif-deleted", "tag": "18a33129-897d-4e1f-8fb9-17adcd5c0b2d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:24:47.054898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-06b0ed72-06e2-4d59-bc35-4340dde39435 req-ec466c41-882f-425c-87fc-584249fdfd54 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:47.055346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-06b0ed72-06e2-4d59-bc35-4340dde39435 req-ec466c41-882f-425c-87fc-584249fdfd54 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:47.067513 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-06b0ed72-06e2-4d59-bc35-4340dde39435 req-ec466c41-882f-425c-87fc-584249fdfd54 service nova] Creating event network-vif-deleted:18a33129-897d-4e1f-8fb9-17adcd5c0b2d for instance c86f5812-485f-4bde-874d-3ab5475b099d on hv-cinder-79760 Jul 18 14:24:47.072743 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-06b0ed72-06e2-4d59-bc35-4340dde39435 req-ec466c41-882f-425c-87fc-584249fdfd54 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091141 Jul 18 14:24:47.073374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 373/757] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:24:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:24:47.695652 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:47.697056 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] [instance: c86f5812-485f-4bde-874d-3ab5475b099d] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:24:47.705084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:47.705527 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:47.706687 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:24:47.707355 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:24:47.724101 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] HTTP exception thrown: Instance c86f5812-485f-4bde-874d-3ab5475b099d could not be found. Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Request method failure captured: Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d HTTP/1.1 Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WxeGGN3Bgz0DYZiQ_wkIx4cqApFkwt3nYYLfRvpVgTcJTkkl0eGniRioPiO6jHxM5Be0Ik-n7LNpErBR_Uz0EQR_pEY-Wf55Ec7znhOgJ8wOrsDDAZ7vFrkXzj_X8OeOhGXm65eHhkeT6YKf9NxwiXwvm7OvPwxGvwSl_zo-5DxeJQ Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: af54954fbeeb4772ad57290fceb3b177 Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestMinimumBasicScenario-289253531 Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:24:47.725762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/af54954fbeeb4772ad57290fceb3b177"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/af54954fbeeb4772ad57290fceb3b177"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/af54954fbeeb4772ad57290fceb3b177"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_af54954fbeeb4772ad57290fceb3b177", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestMinimumBasicScenario-289253531 Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: af54954fbeeb4772ad57290fceb3b177 Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestMinimumBasicScenario-289253531 Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-TestMinimumBasicScenario-289253531-project Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a9057278ae1c42a5a2802a3be11828df Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestMinimumBasicScenario-289253531-project Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance c86f5812-485f-4bde-874d-3ab5475b099d could not be found. Jul 18 14:24:47.727297 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'c86f5812-485f-4bde-874d-3ab5475b099d'} Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c86f5812-485f-4bde-874d-3ab5475b099d could not be found. Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:24:47.728099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c86f5812-485f-4bde-874d-3ab5475b099d could not be found. Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c86f5812-485f-4bde-874d-3ab5475b099d could not be found. Jul 18 14:24:47.729805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:24:47.731911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Returning 404 to user: Instance c86f5812-485f-4bde-874d-3ab5475b099d could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:24:47.731911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-52218caf-9703-499d-a03a-794c32fe2c1b tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d" status: 404 len: 111 microversion: 2.1 time: 0.036108 Jul 18 14:24:47.731911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 385/758] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:24:47 2022] GET /compute/v2.1/servers/c86f5812-485f-4bde-874d-3ab5475b099d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:24:47.737457 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b6bf4c2d-9bf2-4cda-a0ad-1d2605f1a383 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] Calling method '.version_select at 0x7fb53a3a05e0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:24:47.762031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b6bf4c2d-9bf2-4cda-a0ad-1d2605f1a383 tempest-TestMinimumBasicScenario-289253531 tempest-TestMinimumBasicScenario-289253531-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-990223256" status: 202 len: 0 microversion: 2.1 time: 0.029180 Jul 18 14:24:47.763002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 374/759] 10.222.0.71 () {58 vars in 1268 bytes} [Mon Jul 18 14:24:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-990223256 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:25:08.761228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:08.762505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:08.765633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:08.766377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=48,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:08.776961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:08.777922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:08.779198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:08.779904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:08.812157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-429f79d7-35b7-4e3f-87c3-bd6320aa3de7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057089 Jul 18 14:25:08.812747 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 386/760] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:08 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:25:08.881320 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:08.882075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:08.886074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:08.886619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:08.894486 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:08.894927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:08.895684 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:08.896120 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:08.923491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:25:09.010741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f07ffefe-6d2f-405c-9dfb-ecaf438da0b4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 204 len: 0 microversion: 2.1 time: 0.130651 Jul 18 14:25:09.011248 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 375/761] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:25:08 2022] DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:25:09.020165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:09.020885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:09.027231 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:09.027693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:09.028473 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:09.028905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:09.170520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:09.178917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-68aa5617-d250-4610-8a28-a93e1cbeeb38 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1670 microversion: 2.1 time: 0.163115 Jul 18 14:25:09.179504 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 387/762] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:09 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1670 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:10.080472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:10.081137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:10.087295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.087742 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.088524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.088956 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.185060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lazy-loading 'services' on Instance uuid 01d05706-af03-4d2d-9a35-219ad3d890fd {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:10.196638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:10.197244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:10.204814 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.205272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.206091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.206531 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.275454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dec8726d-c3cb-4641-ba64-160756397a48 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments/736c40c7-6d40-469a-8fd5-f8eb767612ef" status: 202 len: 0 microversion: 2.1 time: 0.199330 Jul 18 14:25:10.276307 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 376/763] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:25:10 2022] DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments/736c40c7-6d40-469a-8fd5-f8eb767612ef => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:25:10.286176 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:10.287260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:10.293986 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.294276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.295454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:10.295454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:10.329617 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3df5e407-788b-4c8d-95a8-d016ce583a73 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048377 Jul 18 14:25:10.330542 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 377/764] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:10 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:10.356243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:10.368698 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-97cda872-4074-40b8-8fa8-6fc74c8b6c59 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1670 microversion: 2.1 time: 0.175726 Jul 18 14:25:10.369190 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 388/765] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:10 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1670 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:11.343642 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:11.344911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:11.352435 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:11.352955 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:11.353813 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:11.354249 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:11.388995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:11.390153 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:11.394120 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e32fbf6d-17d4-40c6-8898-779347a400bb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055220 Jul 18 14:25:11.394936 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 378/766] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:11 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:11.399799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:11.400241 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:11.401023 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:11.401449 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:11.550091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:11.558167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-baac8ce7-072d-464c-b30e-802d91e5bba8 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1670 microversion: 2.1 time: 0.174940 Jul 18 14:25:11.558752 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 389/767] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:11 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1670 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:12.406538 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:12.408653 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:12.423379 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.423871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.424888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.425327 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.459568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-07827047-fcc1-4361-81ab-812e310d3add tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057274 Jul 18 14:25:12.460150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 379/768] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:12 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:25:12.547691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:12.548434 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:12.556128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.556700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.557550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.558076 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.577461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:12.578380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:12.584636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.585093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.586043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.586444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.587676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:25:12.672559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:12.682107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c2f4e8a6-4a4c-4585-90bf-c18c5b0e5c5f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1603 microversion: 2.1 time: 0.109439 Jul 18 14:25:12.693311 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-51b41fc7-4d38-466e-9b36-11be5931f3b5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 204 len: 0 microversion: 2.1 time: 0.149518 Jul 18 14:25:12.693980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 390/769] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:25:12 2022] DELETE /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:25:12.706277 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 380/770] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:12 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1603 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:12.707289 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:12.707897 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:12.716650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.717993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.719571 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.720375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.834436 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-6080c652-a34d-43f0-903e-a0eb06630e24 req-0bdcb938-33dd-4c81-8da9-ee4c86096c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3954bb52-b979-4fd0-84c0-c95c060085eb", "name": "network-vif-deleted", "tag": "38d0ae5e-b6aa-4c94-b263-4e607bc0997c"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:12.843826 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-6080c652-a34d-43f0-903e-a0eb06630e24 req-0bdcb938-33dd-4c81-8da9-ee4c86096c2c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:12.844578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-6080c652-a34d-43f0-903e-a0eb06630e24 req-0bdcb938-33dd-4c81-8da9-ee4c86096c2c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:12.859952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-6080c652-a34d-43f0-903e-a0eb06630e24 req-0bdcb938-33dd-4c81-8da9-ee4c86096c2c service nova] Creating event network-vif-deleted:38d0ae5e-b6aa-4c94-b263-4e607bc0997c for instance 3954bb52-b979-4fd0-84c0-c95c060085eb on hv-cinder-79760 Jul 18 14:25:12.865752 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-6080c652-a34d-43f0-903e-a0eb06630e24 req-0bdcb938-33dd-4c81-8da9-ee4c86096c2c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035172 Jul 18 14:25:12.867891 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 381/771] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:12.868552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:12.876872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-433d2bed-3222-4dc7-8739-b624faaac597 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1688 microversion: 2.1 time: 0.174322 Jul 18 14:25:12.877583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 391/772] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:12 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:13.706584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:13.707413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:13.715081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.715597 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.716385 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.716823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.786635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:13.794213 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-131c9c77-8bcb-4d75-a161-16df12ffa3dc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1603 microversion: 2.1 time: 0.092117 Jul 18 14:25:13.794772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 382/773] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:13 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:13.895655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:13.896477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:13.903632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.904067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:13.904879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:13.905314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.046570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:14.055496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d0457a5d-ac78-45d1-965e-c5476a5bc16c tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1688 microversion: 2.1 time: 0.163907 Jul 18 14:25:14.056074 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 392/774] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:13 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:14.820273 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:14.820967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:14.828265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:14.828746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.829527 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:14.829999 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:14.896380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:14.904133 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f8c61fd2-b524-4f82-bc6d-50b498619ef4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1603 microversion: 2.1 time: 0.095769 Jul 18 14:25:14.904696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 383/775] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:14 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1603 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:15.073346 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:15.073992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:15.080974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:15.081423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:15.082225 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:15.082646 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:15.235897 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:15.243878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c9636119-7132-4a5b-9e83-4971728cc62e tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1688 microversion: 2.1 time: 0.174401 Jul 18 14:25:15.244460 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 393/776] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:15 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1688 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:15.922349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:15.922904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:15.929958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:15.930419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:15.931187 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:15.931627 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:16.005888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:16.014216 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bc5ddd8b-cfc5-44eb-bd28-38d8f5aedf83 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1603 microversion: 2.1 time: 0.095941 Jul 18 14:25:16.014786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 384/777] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:15 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1603 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:16.261265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:16.261884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:16.269240 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:16.269686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:16.270491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:16.270928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:16.412751 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:16.420832 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8875ba19-bdcf-428b-b107-c1f533448036 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1688 microversion: 2.1 time: 0.163506 Jul 18 14:25:16.421397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 394/778] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:16 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:17.035573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:17.036152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:17.046204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:17.046722 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:17.047546 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:17.047974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:17.123567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:17.134238 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5ba4682f-cea2-42b6-b749-8d67f1bdacbb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1603 microversion: 2.1 time: 0.105047 Jul 18 14:25:17.134954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 385/779] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:17 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1603 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:17.438859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:17.439482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:17.446488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:17.446936 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:17.447700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:17.448133 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:17.599135 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:17.612918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aa4b42d7-05d5-4fe3-ae0a-db4a40b3dfcc tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1688 microversion: 2.1 time: 0.178453 Jul 18 14:25:17.613496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 395/780] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:17 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:18.153938 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:18.154637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:18.162315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:18.162822 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:18.163628 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:18.164060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:18.197258 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:18.197685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:18.198181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lazy-loading 'fault' on Instance uuid 3954bb52-b979-4fd0-84c0-c95c060085eb {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:18.241023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:18.249090 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-53e58d5f-8ac7-402f-b84a-1cf5a69951d1 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 200 len: 1326 microversion: 2.1 time: 0.099072 Jul 18 14:25:18.249677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 386/781] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:18 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:18.631075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:18.631754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:18.638573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:18.639026 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:18.639827 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:18.640259 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:18.784091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:18.792108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ee315ac8-fce2-425a-ab5b-ae81c0866fea tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1688 microversion: 2.1 time: 0.165416 Jul 18 14:25:18.792681 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 396/782] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:18 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:19.271228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-4f5e1c24-b0cb-43a2-84e4-ef9746dcde81 req-9f016e8a-28ce-4f6e-a8d6-9eaddadea361 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01d05706-af03-4d2d-9a35-219ad3d890fd", "name": "network-vif-deleted", "tag": "20e66e05-7f29-4c65-9267-fa171a53da05"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:19.273588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:19.274952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:19.291072 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4f5e1c24-b0cb-43a2-84e4-ef9746dcde81 req-9f016e8a-28ce-4f6e-a8d6-9eaddadea361 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.291505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4f5e1c24-b0cb-43a2-84e4-ef9746dcde81 req-9f016e8a-28ce-4f6e-a8d6-9eaddadea361 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.296317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.296859 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.298391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.298835 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.323807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] HTTP exception thrown: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Request method failure captured: Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb HTTP/1.1 Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvrnVaM4aqfzPiJD4kK4tLy7Mwr8qSOVkYD3tg26FLXb6tw28Ho14cMGOM5avv-d7l6FwEWD6Y9fN25uSz3Ye4oDTbkG3e5XmH3PT3ntotUO0Pj0J5FZeuUktRgjQ2BrKbuq_2rD1Q2-f4REjM9kJuNc5ZGXHvDJY8ShBJOFyVzyvs Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:25:19.325506 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1166ac77e8e403aa5f81e452bc039ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 5ca8be8093b547ee953ea646f90fdcae Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:25:19.327157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '3954bb52-b979-4fd0-84c0-c95c060085eb'} Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:19.328225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:25:19.330856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:19.333152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Returning 404 to user: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:19.333152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-27a8bef8-3f30-471e-a02d-e3c5ca1ddbc4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 404 len: 111 microversion: 2.1 time: 0.064694 Jul 18 14:25:19.333152 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 387/783] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:19 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:25:19.334245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-4f5e1c24-b0cb-43a2-84e4-ef9746dcde81 req-9f016e8a-28ce-4f6e-a8d6-9eaddadea361 service nova] Creating event network-vif-deleted:20e66e05-7f29-4c65-9267-fa171a53da05 for instance 01d05706-af03-4d2d-9a35-219ad3d890fd on hv-cinder-79760 Jul 18 14:25:19.340308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-4f5e1c24-b0cb-43a2-84e4-ef9746dcde81 req-9f016e8a-28ce-4f6e-a8d6-9eaddadea361 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072621 Jul 18 14:25:19.341254 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 397/784] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:19.348521 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:19.349025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:19.354156 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-de7cdc7d-77c6-4a4c-879d-3e178a2f610c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '.version_select at 0x7fb53a01e9d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:19.367060 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.368463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.370741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.371996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.390974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-de7cdc7d-77c6-4a4c-879d-3e178a2f610c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-44830989" status: 202 len: 0 microversion: 2.1 time: 0.047783 Jul 18 14:25:19.393773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 398/785] 10.222.0.71 () {58 vars in 1214 bytes} [Mon Jul 18 14:25:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-44830989 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:25:19.414560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b2d75bd4-a155-4881-afb6-eca68d24fbf4 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/ips" status: 200 len: 152 microversion: 2.20 time: 0.075517 Jul 18 14:25:19.415224 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 388/786] 10.222.0.71 () {60 vars in 1288 bytes} [Mon Jul 18 14:25:19 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/ips => generated 152 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:25:19.810310 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:19.811137 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:19.819245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.819978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.820830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.821425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.861619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.862401 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.863013 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lazy-loading 'fault' on Instance uuid 01d05706-af03-4d2d-9a35-219ad3d890fd {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:19.916962 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:19.926245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-00cafef8-c079-4e2e-aa1a-73e1d502dc6b tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 200 len: 1335 microversion: 2.1 time: 0.120196 Jul 18 14:25:19.927429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 399/787] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:19 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 1335 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:19.946609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:19.947370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:19.959430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.960195 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.961325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:19.965013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:19.991565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c8d81a5d-3a83-4be9-aa50-23e1e4cd5e20 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/ips" status: 200 len: 149 microversion: 2.1 time: 0.049795 Jul 18 14:25:19.992531 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 389/788] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:25:19 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:20.307378 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9288052f-0dfc-4067-8391-8a71e91ced75 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: .version_select at 0x7fb53a074820>, body: {"keypair": {"name": "tempest-keypair-787372105", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLjUejbrAuqf0sEPQgU0bh3TIj5peeBADYlZinI2sLmKNohb7PSuhKtsZ9FXlmyTMcdZoLbVPLxmgH+cl3p/nsy4M5mTp7/i8tN79pcqLTNmyQd7qpua2YP9W4b1NVGydg=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:20.325089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9288052f-0dfc-4067-8391-8a71e91ced75 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:25:20.330307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-9288052f-0dfc-4067-8391-8a71e91ced75 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for user 5ca8be8093b547ee953ea646f90fdcae and project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:25:20.369300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9288052f-0dfc-4067-8391-8a71e91ced75 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.066075 Jul 18 14:25:20.370668 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 400/789] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:25:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:20.944001 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:20.944755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 01d05706-af03-4d2d-9a35-219ad3d890fd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:20.951889 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:20.952439 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:20.953673 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:20.953882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:20.967978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] HTTP exception thrown: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd could not be found. Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Request method failure captured: Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd HTTP/1.1 Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvqT-vMuaaccIbC9_d9fh0zgzEeFdGY0u6NXMWx0l2Uebt77StaetXx51TnLsBNIos7d85_Y2rC9J6HE5xJO8mTOeTP_8mJRjF9v0cXZCZ7nGdI4ff8IHrAZ_3NhVBwts4qNbPleLh4-G9N74qPZe5NrSSEx7tK7W0liRixYb4CLsY Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:25:20.969974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_38cf167c2fc74ac09d6f6d6f81829cda", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 8a45cafadb824e08bd9e86fd0d5c4c71 Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd could not be found. Jul 18 14:25:20.971337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '01d05706-af03-4d2d-9a35-219ad3d890fd'} Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd could not be found. Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:20.972072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd could not be found. Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd could not be found. Jul 18 14:25:20.973203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:20.974266 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Returning 404 to user: Instance 01d05706-af03-4d2d-9a35-219ad3d890fd could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:20.974266 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-46f6727a-39cb-4346-b9cb-95104d3dcbdf tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd" status: 404 len: 111 microversion: 2.1 time: 0.031419 Jul 18 14:25:20.974266 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 390/790] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:20 2022] GET /compute/v2.1/servers/01d05706-af03-4d2d-9a35-219ad3d890fd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:25:20.981075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ffca4faa-f777-4670-bc4a-c20b0eb4c5f5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '.version_select at 0x7fb53eabdf70>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:21.000012 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ffca4faa-f777-4670-bc4a-c20b0eb4c5f5 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958015425" status: 202 len: 0 microversion: 2.1 time: 0.023260 Jul 18 14:25:21.000593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 401/791] 10.222.0.71 () {58 vars in 1220 bytes} [Mon Jul 18 14:25:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1958015425 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:25:21.412584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "988bc546-98c3-47bd-b78b-1f034ac1bded"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:21.413766 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:21.419733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:21.420204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:21.421045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:21.421373 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:21.439281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:21.698963 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e3ea952f-a856-40a8-98c8-efadfe6a88f8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289915 Jul 18 14:25:21.705104 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 391/792] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:25:21 2022] POST /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:22.240095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:22.240779 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:22.251899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:22.252651 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:22.253402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:22.253789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:22.278819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lazy-loading 'flavor' on Instance uuid 37e4e803-75d9-4b7d-8dfa-98d465a1e76b {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:22.338482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:22.369226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-685806683", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d8c134e8-e1cb-4e62-935e-e3b599e00b1c"}], "security_groups": [{"name": "tempest-securitygroup--1148226264"}], "key_name": "tempest-keypair-787372105", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:22.480732 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] validate_networks() for [('d8c134e8-e1cb-4e62-935e-e3b599e00b1c', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:25:22.564916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b62b3f96-2aa6-4cc0-9798-a403c8aeed4a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/action" status: 202 len: 0 microversion: 2.20 time: 0.332057 Jul 18 14:25:22.565572 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 402/793] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 18 14:25:22 2022] POST /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/action => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:25:22.576891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:22.577765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:22.585838 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:22.586578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:22.587571 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:22.588128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:23.020085 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:23.029577 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:23.031437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:23.033088 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f8fa2234-8f43-4dc6-9d7b-86317329fdc0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.461067 Jul 18 14:25:23.033934 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 403/794] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:22 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:25:23.349854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:25:23.350313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:25:23.351058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:25:23.351594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:25:23.352197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:25:23.366065 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:23.366633 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:23.367784 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:23.368314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:23.387366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:25:23.391867 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Getting quotas for user 5ca8be8093b547ee953ea646f90fdcae and project e1166ac77e8e403aa5f81e452bc039ac. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:25:23.404498 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:25:23.407276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:25:23.457804 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-162a20c4-ea88-426f-b273-ab799ab37f66 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.093503 Jul 18 14:25:23.464036 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 392/795] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:25:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:25:23.470579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3d27ac87-f60d-4684-a1e5-67f19bc9884d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:23.471393 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3d27ac87-f60d-4684-a1e5-67f19bc9884d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:23.540960 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3d27ac87-f60d-4684-a1e5-67f19bc9884d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:23.548412 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3d27ac87-f60d-4684-a1e5-67f19bc9884d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1236 microversion: 2.1 time: 0.082827 Jul 18 14:25:23.549204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 404/796] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:23 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1236 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:24.056283 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:24.057142 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:24.065863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.066429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.067207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.067650 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.217636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:24.226713 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:24.228287 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:24.229330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4900eee1-dae7-4796-9949-49ecd216e97e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.177843 Jul 18 14:25:24.236168 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 393/797] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:24 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:24.566481 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:24.567151 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:24.570491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:24.571220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:24.576261 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.576693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.577475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.577852 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.577974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.578079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.578838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.579941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.606411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:25:24.651800 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:24.662331 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0c0130b9-cf98-4913-b46b-1a4fd97816f7 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1288 microversion: 2.1 time: 0.100553 Jul 18 14:25:24.662926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 405/798] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:24 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:24.707194 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f3cd7aa8-0071-41e1-8cc7-de34f00051f8 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 204 len: 0 microversion: 2.1 time: 0.141322 Jul 18 14:25:24.707961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 394/799] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:25:24 2022] DELETE /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:25:24.717978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:24.718497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:24.729043 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.729640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.730583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:24.731093 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:24.870015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:24.878752 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-119ecff1-594e-49d0-a48d-ade082520157 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1509 microversion: 2.1 time: 0.165454 Jul 18 14:25:24.879295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 406/800] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:24 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:25.249475 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:25.250186 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:25.257491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:25.257969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:25.258728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:25.259154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:25.410882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:25.422772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:25.427393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:25.427393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2600876a-c896-4065-987d-fb807e1f5dea tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.180547 Jul 18 14:25:25.427393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 395/801] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:25 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:25.682894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:25.683475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:25.691345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:25.691819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:25.692595 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:25.693097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:25.765249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:25.773337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-deb534fb-006b-4c1a-8f42-3a6a3f71ae72 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1306 microversion: 2.1 time: 0.096298 Jul 18 14:25:25.777821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 407/802] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:25 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:25.899638 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:25.900223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:25.908165 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:25.908616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:25.909376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:25.909888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:26.107875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:26.116313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ce321b16-7795-4cfe-8644-3ac93b0739c2 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1509 microversion: 2.1 time: 0.221695 Jul 18 14:25:26.117009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 396/803] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:25 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1509 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:26.446694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:26.449014 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:26.455114 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:26.455692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:26.456844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:26.457091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:26.724101 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:26.738171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:26.740380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:26.741593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b951ada1-1cf2-406e-80db-35bb3c86bc33 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.299818 Jul 18 14:25:26.742349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 408/804] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:26 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:26.793805 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:26.794890 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:26.803289 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:26.803887 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:26.804556 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:26.805176 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.074978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:27.086593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4c6e3c78-f243-4f43-8095-381a1c15750d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.298480 Jul 18 14:25:27.087537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 397/805] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:26 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:27.134071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:27.135077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:27.145708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.150070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.151074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.151526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.193547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.194203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.194878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lazy-loading 'fault' on Instance uuid 7677bd33-c598-4302-a355-13c48bca9e32 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:27.231755 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-3c59dffd-5805-4264-9ec9-ba49535807be req-c5d8d1f1-0ba7-40f6-a840-02618b7183bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7677bd33-c598-4302-a355-13c48bca9e32", "name": "network-vif-deleted", "tag": "ca3680d0-6384-4efa-85ac-32d714d865a4"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:27.241270 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-3c59dffd-5805-4264-9ec9-ba49535807be req-c5d8d1f1-0ba7-40f6-a840-02618b7183bc service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.241871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-3c59dffd-5805-4264-9ec9-ba49535807be req-c5d8d1f1-0ba7-40f6-a840-02618b7183bc service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.258523 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-3c59dffd-5805-4264-9ec9-ba49535807be req-c5d8d1f1-0ba7-40f6-a840-02618b7183bc service nova] Creating event network-vif-deleted:ca3680d0-6384-4efa-85ac-32d714d865a4 for instance 7677bd33-c598-4302-a355-13c48bca9e32 on hv-cinder-79760 Jul 18 14:25:27.265345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-3c59dffd-5805-4264-9ec9-ba49535807be req-c5d8d1f1-0ba7-40f6-a840-02618b7183bc service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275772 Jul 18 14:25:27.266880 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 409/806] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:27.271638 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:27.287952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a3d39fbe-82c8-4b48-94e0-29da85a62acb tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 200 len: 1312 microversion: 2.1 time: 0.157925 Jul 18 14:25:27.289009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 398/807] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:27 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:27.525184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-696f7357-f41e-45f1-865f-1e99020e4e61 req-774ae7eb-28df-4fea-9166-8f5c8bcded7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fdc2f28-6e4e-4620-9ff1-3e41b54dae05", "tag": "5fb9cd92-9a41-4e68-91c0-0da02d9f33b8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:27.535764 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-696f7357-f41e-45f1-865f-1e99020e4e61 req-774ae7eb-28df-4fea-9166-8f5c8bcded7c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.536416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-696f7357-f41e-45f1-865f-1e99020e4e61 req-774ae7eb-28df-4fea-9166-8f5c8bcded7c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.558822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-696f7357-f41e-45f1-865f-1e99020e4e61 req-774ae7eb-28df-4fea-9166-8f5c8bcded7c service nova] Creating event network-changed:5fb9cd92-9a41-4e68-91c0-0da02d9f33b8 for instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 on hv-cinder-79760 Jul 18 14:25:27.563880 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-696f7357-f41e-45f1-865f-1e99020e4e61 req-774ae7eb-28df-4fea-9166-8f5c8bcded7c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043307 Jul 18 14:25:27.564767 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 410/808] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:27.761772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:27.762382 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:27.769281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.769777 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.770561 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:27.770998 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:27.927653 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:27.936092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:27.937590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:27.939159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-26dbba31-4771-47f8-9928-fefedff36903 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.181797 Jul 18 14:25:27.939726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 399/809] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:27 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:28.110019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:28.111968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:28.120047 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.121482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.122614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.123295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.265612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:28.273738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-5ea0de10-ed51-41f1-9f30-3e74e7dff20d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.168340 Jul 18 14:25:28.274235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 411/810] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:28 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:28.305962 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:28.306565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: 7677bd33-c598-4302-a355-13c48bca9e32] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:28.313100 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.313551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.314360 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.314835 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.329433 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] HTTP exception thrown: Instance 7677bd33-c598-4302-a355-13c48bca9e32 could not be found. Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Request method failure captured: Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 HTTP/1.1 Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvqT-vMuaaccIbC9_d9fh0zgzEeFdGY0u6NXMWx0l2Uebt77StaetXx51TnLsBNIos7d85_Y2rC9J6HE5xJO8mTOeTP_8mJRjF9v0cXZCZ7nGdI4ff8IHrAZ_3NhVBwts4qNbPleLh4-G9N74qPZe5NrSSEx7tK7W0liRixYb4CLsY Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:25:28.331153 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_38cf167c2fc74ac09d6f6d6f81829cda", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 8a45cafadb824e08bd9e86fd0d5c4c71 Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 7677bd33-c598-4302-a355-13c48bca9e32 could not be found. Jul 18 14:25:28.332639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '7677bd33-c598-4302-a355-13c48bca9e32'} Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7677bd33-c598-4302-a355-13c48bca9e32 could not be found. Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:28.333488 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7677bd33-c598-4302-a355-13c48bca9e32 could not be found. Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7677bd33-c598-4302-a355-13c48bca9e32 could not be found. Jul 18 14:25:28.334739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:28.335855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Returning 404 to user: Instance 7677bd33-c598-4302-a355-13c48bca9e32 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:28.335855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4f176a81-898f-4bbf-b3cd-518d48561f0f tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32" status: 404 len: 111 microversion: 2.1 time: 0.030627 Jul 18 14:25:28.335855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 400/811] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:28 2022] GET /compute/v2.1/servers/7677bd33-c598-4302-a355-13c48bca9e32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:25:28.342453 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:28.342986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:28.350756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.351232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.352176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.352691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.380182 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:25:28.474006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2afd4384-03a5-4f38-bed7-9d0cc8c3d5fd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "DELETE /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 204 len: 0 microversion: 2.1 time: 0.135370 Jul 18 14:25:28.477632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 412/812] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:25:28 2022] DELETE /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:25:28.487842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:28.489104 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:28.497790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.498507 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.499480 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.500110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.647074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:28.656400 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-84493c3d-4dcd-4430-97ac-de1ff43c5e15 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.176700 Jul 18 14:25:28.657150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 401/813] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:28 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:28.958482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:28.959172 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:28.965619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.966094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:28.966852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:28.967280 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.112675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:29.121749 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:29.123254 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:29.124422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cc0bdc98-6c26-4813-b38a-293665880ca6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.170367 Jul 18 14:25:29.124983 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 413/814] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:28 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:29.291416 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:29.292092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:29.299420 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.299868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.300628 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.301061 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.349879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "988bc546-98c3-47bd-b78b-1f034ac1bded"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:29.350936 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:29.356874 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.357314 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.358111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.358534 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.440912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Invalid volume: volume 988bc546-98c3-47bd-b78b-1f034ac1bded is already attached to instances: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf Jul 18 14:25:29.441146 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: POST /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments HTTP/1.1 Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 74 Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:25:29.442683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {"volumeAttachment": {"volumeId": "988bc546-98c3-47bd-b78b-1f034ac1bded"}} Jul 18 14:25:29.444341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Invalid volume: volume 988bc546-98c3-47bd-b78b-1f034ac1bded is already attached to instances: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'server_id': '2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf', 'body': {'volumeAttachment': {'volumeId': '988bc546-98c3-47bd-b78b-1f034ac1bded'}}} Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 988bc546-98c3-47bd-b78b-1f034ac1bded is already attached to instances: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:29.445432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 988bc546-98c3-47bd-b78b-1f034ac1bded is already attached to instances: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:29.446878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 988bc546-98c3-47bd-b78b-1f034ac1bded is already attached to instances: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 400 to user: Invalid volume: volume 988bc546-98c3-47bd-b78b-1f034ac1bded is already attached to instances: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-42fce20c-5b0f-4aee-a92c-40118af8c171 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098376 Jul 18 14:25:29.448588 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 414/815] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:25:29 2022] POST /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 18 14:25:29.452459 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d75b575f-ecc6-476f-aeba-fb1304bb8d5a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.165328 Jul 18 14:25:29.453030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 402/816] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:29 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:29.506807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:29.507309 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:29.513578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.514056 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.514810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.515232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.616325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lazy-loading 'services' on Instance uuid 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:29.675781 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:29.676578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:29.683539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.684067 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.684856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.685285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.700354 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bebdd28f-5c1b-4752-bcf0-8dd8f30dec42 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments/988bc546-98c3-47bd-b78b-1f034ac1bded" status: 202 len: 0 microversion: 2.1 time: 0.197259 Jul 18 14:25:29.700935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 415/817] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:25:29 2022] DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments/988bc546-98c3-47bd-b78b-1f034ac1bded => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:25:29.710850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:29.711910 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:29.718332 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.718782 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.720176 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:29.720607 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:29.753251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3f783603-8591-484c-a44b-a861b9d1e846 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046236 Jul 18 14:25:29.754051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 416/818] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:29 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:29.833096 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:29.841220 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-90f64447-8b86-4bf4-ae48-d1ad8e947491 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.170624 Jul 18 14:25:29.841870 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 403/819] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:29 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:30.145059 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:30.145965 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:30.154032 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.154484 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.155514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.155951 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.313949 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:30.325474 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:30.328084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:30.329943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d8e0da85-a09b-4e92-96e6-8674ecfb498f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.189836 Jul 18 14:25:30.330754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 417/820] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:30 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:30.471757 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:30.472380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:30.480364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.481038 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.482091 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.482677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.635036 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:30.643302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8eb213fb-a8e0-4bc0-9911-ad6de16c12c4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.176616 Jul 18 14:25:30.643893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 404/821] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:30 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:30.765386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:30.766225 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:30.773626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.774128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.775018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.775490 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.802736 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:30.808116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4a194659-828c-4f43-a823-4898dd5e5b17 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047195 Jul 18 14:25:30.812138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 418/822] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:30 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:30.860444 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:30.861794 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:30.867723 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.868563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:30.869415 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:30.869822 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.026983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:31.036434 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e01465f8-9d7d-430d-882c-efe8c49a4200 tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1522 microversion: 2.1 time: 0.180359 Jul 18 14:25:31.037296 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 405/823] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:30 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:31.349517 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:31.350160 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:31.358648 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:31.359107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.359972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:31.360706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.602827 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:31.615781 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:31.617878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:31.619310 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b088e106-e2f1-4b8e-8a3b-6bbd8f7dc008 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.273937 Jul 18 14:25:31.619858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 419/824] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:31 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:31.660842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:31.661530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:31.668386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:31.668842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.669616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:31.670095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.674416 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:31.820380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:31.821427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:31.824462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:31.829418 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:31.829418 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.830393 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:31.830691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:31.865596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-438a14ef-a84a-46eb-86ff-48be59d37f21 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049115 Jul 18 14:25:31.866119 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 420/825] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:31 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:31.886452 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:31.895117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-124e447d-6ab1-4b68-a0fd-fea54ca94fea tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.238296 Jul 18 14:25:31.895810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 406/826] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:31 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:32.058177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:32.058829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:32.066321 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-54c862b6-5656-49a5-b72f-f479a571234f req-b2d51683-43a7-4f3b-a2d7-2c0708467747 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fedbc653-17b5-4127-8c87-b446551d81dc", "name": "network-vif-deleted", "tag": "88e47ba7-e850-4769-8483-f5fc871ea2d9"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:32.066674 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.066674 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.066674 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.066936 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.072657 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-54c862b6-5656-49a5-b72f-f479a571234f req-b2d51683-43a7-4f3b-a2d7-2c0708467747 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.073145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-54c862b6-5656-49a5-b72f-f479a571234f req-b2d51683-43a7-4f3b-a2d7-2c0708467747 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.085010 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-54c862b6-5656-49a5-b72f-f479a571234f req-b2d51683-43a7-4f3b-a2d7-2c0708467747 service nova] Creating event network-vif-deleted:88e47ba7-e850-4769-8483-f5fc871ea2d9 for instance fedbc653-17b5-4127-8c87-b446551d81dc on hv-cinder-79760 Jul 18 14:25:32.090297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-54c862b6-5656-49a5-b72f-f479a571234f req-b2d51683-43a7-4f3b-a2d7-2c0708467747 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029654 Jul 18 14:25:32.090880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 407/827] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:32.135458 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a45cafadb824e08bd9e86fd0d5c4c71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '38cf167c2fc74ac09d6f6d6f81829cda', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:32.143440 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b100251d-5276-45ef-b84f-058f993e64ef tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 200 len: 1480 microversion: 2.1 time: 0.089319 Jul 18 14:25:32.144011 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 421/828] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:32 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 1480 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:32.639741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:32.640548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:32.644089 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:32.648370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.648813 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.649576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.650059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.809873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:32.819795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:32.821495 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:32.822919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-50fd7d5d-5b9e-4afd-9899-97f215df4682 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.187971 Jul 18 14:25:32.823500 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 408/829] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:32 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:32.877750 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:32.878745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:32.885267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.885703 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.886538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.886933 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.912838 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:32.913423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:32.918377 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ce1d43d2-809b-438c-b987-f7232ace4105 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045422 Jul 18 14:25:32.918948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 422/830] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:25:32 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:25:32.919855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.920313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.921095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:32.921533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:32.995195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:32.996286 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:33.007978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.008808 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.009828 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.010612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.046753 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:25:33.073222 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:33.082513 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1631bd7d-0a95-4ab6-8606-1d3000412516 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.173465 Jul 18 14:25:33.083083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 409/831] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:32 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:33.147107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cbebae4b-a124-4e86-8661-2da6fa5506ac tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 204 len: 0 microversion: 2.1 time: 0.155539 Jul 18 14:25:33.148695 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 423/832] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:25:32 2022] DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:25:33.161314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:33.161716 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:33.162873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:33.163848 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] [instance: fedbc653-17b5-4127-8c87-b446551d81dc] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:33.170081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.170747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.170873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.171398 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.172564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.172907 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.173423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.174071 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.190823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] HTTP exception thrown: Instance fedbc653-17b5-4127-8c87-b446551d81dc could not be found. Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Request method failure captured: Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc HTTP/1.1 Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvqT-vMuaaccIbC9_d9fh0zgzEeFdGY0u6NXMWx0l2Uebt77StaetXx51TnLsBNIos7d85_Y2rC9J6HE5xJO8mTOeTP_8mJRjF9v0cXZCZ7nGdI4ff8IHrAZ_3NhVBwts4qNbPleLh4-G9N74qPZe5NrSSEx7tK7W0liRixYb4CLsY Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:25:33.193089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/38cf167c2fc74ac09d6f6d6f81829cda"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_38cf167c2fc74ac09d6f6d6f81829cda", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 38cf167c2fc74ac09d6f6d6f81829cda Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-536270013 Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 8a45cafadb824e08bd9e86fd0d5c4c71 Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-ServerRescueNegativeTestJSON-536270013-project Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance fedbc653-17b5-4127-8c87-b446551d81dc could not be found. Jul 18 14:25:33.195380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'fedbc653-17b5-4127-8c87-b446551d81dc'} Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fedbc653-17b5-4127-8c87-b446551d81dc could not be found. Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:33.196275 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fedbc653-17b5-4127-8c87-b446551d81dc could not be found. Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fedbc653-17b5-4127-8c87-b446551d81dc could not be found. Jul 18 14:25:33.197739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:25:33.199422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] Returning 404 to user: Instance fedbc653-17b5-4127-8c87-b446551d81dc could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:33.199422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f1adf39f-7b40-446c-8f66-698c63e23ebd tempest-ServerRescueNegativeTestJSON-536270013 tempest-ServerRescueNegativeTestJSON-536270013-project] 10.222.0.71 "GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc" status: 404 len: 111 microversion: 2.1 time: 0.039918 Jul 18 14:25:33.200263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 424/833] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:33 2022] GET /compute/v2.1/servers/fedbc653-17b5-4127-8c87-b446551d81dc => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:25:33.332312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:33.340850 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e1f3f73a-8313-4c9f-881d-5cbdb5a2452c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1680 microversion: 2.1 time: 0.187024 Jul 18 14:25:33.348268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 410/834] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:33 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1680 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:33.842974 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:33.843705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:33.846065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:33.851471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.851911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:33.852676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:33.853136 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:34.010303 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:34.017998 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:34.019493 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:34.020568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b7060ff4-45a7-4b59-bf96-2e5713d447b8 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.181606 Jul 18 14:25:34.021118 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 425/835] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:33 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:34.100255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:34.101133 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:34.103127 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:34.103882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:34.111288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:34.111879 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:34.112660 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:34.113170 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:34.275137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:34.283726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7c9437ac-f14c-4cb6-bb85-9e1b62bab063 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.187357 Jul 18 14:25:34.284414 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 411/836] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:34 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:34.359512 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:34.362213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:34.368729 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:34.368989 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:34.370003 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:34.370589 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:34.511993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:34.520422 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-73a2c0a8-61fa-416d-be03-4cb9662820b7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1680 microversion: 2.1 time: 0.164723 Jul 18 14:25:34.520891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 426/837] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:34 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:35.041783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:35.042809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:35.057271 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.058154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.059250 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.059989 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.239661 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-8e45377c-5ab2-412d-be11-9d32b0185013 req-7134c209-b877-4967-97c2-ffdf738921f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fdc2f28-6e4e-4620-9ff1-3e41b54dae05", "name": "network-vif-plugged", "status": "completed", "tag": "5fb9cd92-9a41-4e68-91c0-0da02d9f33b8"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:35.248744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-8e45377c-5ab2-412d-be11-9d32b0185013 req-7134c209-b877-4967-97c2-ffdf738921f4 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.249250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-8e45377c-5ab2-412d-be11-9d32b0185013 req-7134c209-b877-4967-97c2-ffdf738921f4 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.263269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-8e45377c-5ab2-412d-be11-9d32b0185013 req-7134c209-b877-4967-97c2-ffdf738921f4 service nova] Creating event network-vif-plugged:5fb9cd92-9a41-4e68-91c0-0da02d9f33b8 for instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 on hv-cinder-79760 Jul 18 14:25:35.269375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-8e45377c-5ab2-412d-be11-9d32b0185013 req-7134c209-b877-4967-97c2-ffdf738921f4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.150298 Jul 18 14:25:35.273054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 427/838] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:35.303968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:35.305087 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:35.313915 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.314669 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.315914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.316829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.351155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:35.359809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:35.367189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:35.370505 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-330cc2c3-7c8f-480f-b65e-c6f19266d5e9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.333511 Jul 18 14:25:35.374322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 412/839] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:35 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:35.538681 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:35.539397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:35.545956 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.546779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.548423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:35.549233 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:35.574168 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:35.584143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e0c5ee19-71b8-4018-b357-26264f48ad3a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.286487 Jul 18 14:25:35.587331 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 428/840] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:35 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:35.793894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:35.803135 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2c40df65-ab07-41f1-aeae-c40c65621464 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1680 microversion: 2.1 time: 0.268157 Jul 18 14:25:35.814165 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 413/841] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:35 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1680 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:36.392607 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:36.393244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:36.400279 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.401380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.402468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.402893 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.606954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:36.610400 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:36.630512 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.631265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.632316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.636898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.649684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:36.659272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:36.662387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:36.664159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bb123960-3f3b-481c-a01c-d6ce6bc1e328 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.275669 Jul 18 14:25:36.665257 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 429/842] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:36 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:36.672281 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-90f3b6b9-ebe8-4e42-9678-3d558a755deb req-3e606630-cf30-4c5d-9be1-09a8904307eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf", "name": "network-vif-deleted", "tag": "8dcf14fa-66e1-4d28-bf09-6e39927373f4"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:36.681571 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-90f3b6b9-ebe8-4e42-9678-3d558a755deb req-3e606630-cf30-4c5d-9be1-09a8904307eb service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.682656 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-90f3b6b9-ebe8-4e42-9678-3d558a755deb req-3e606630-cf30-4c5d-9be1-09a8904307eb service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.721800 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-90f3b6b9-ebe8-4e42-9678-3d558a755deb req-3e606630-cf30-4c5d-9be1-09a8904307eb service nova] Creating event network-vif-deleted:8dcf14fa-66e1-4d28-bf09-6e39927373f4 for instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf on hv-cinder-79760 Jul 18 14:25:36.728466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-90f3b6b9-ebe8-4e42-9678-3d558a755deb req-3e606630-cf30-4c5d-9be1-09a8904307eb service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061492 Jul 18 14:25:36.729679 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 430/843] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:36.823157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:36.823910 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:36.832954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.833748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.834739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.835336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.875128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:36.875842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:36.877000 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lazy-loading 'fault' on Instance uuid 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:25:36.910904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:36.920729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-cbf96244-5a28-41ab-b24f-0935472590ac tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1362 microversion: 2.1 time: 0.320269 Jul 18 14:25:36.921830 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 414/844] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:36 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:36.951675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:36.966729 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-09bed187-8f85-4fef-a6df-94976ede3559 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 200 len: 1330 microversion: 2.1 time: 0.148004 Jul 18 14:25:36.976872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 431/845] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:36 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 1330 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:37.683688 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:37.684351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:37.691762 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:37.692565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:37.693550 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:37.694085 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:37.861863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:37.872784 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:37.874320 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:37.875551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4d432439-9b73-4a99-89f4-16a35afc7887 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.195949 Jul 18 14:25:37.876178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 415/846] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:37 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:37.938489 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:37.939518 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:37.947843 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:37.948300 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:37.949089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:37.949525 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:37.984547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:37.986458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:37.995203 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:37.998466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:37.999408 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.000090 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.015807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf HTTP/1.1 Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:25:38.017933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:25:38.019215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf'} Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:25:38.019984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:25:38.021200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:25:38.022384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:25:38.022384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-98c1999a-6d13-411a-9aad-0286293d6197 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 404 len: 111 microversion: 2.1 time: 0.038704 Jul 18 14:25:38.022384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 416/847] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:37 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:25:38.028479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-452ddc8c-588c-4354-8b62-bb8a27542bcb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '.version_select at 0x7fb53a126ee0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:38.065812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-452ddc8c-588c-4354-8b62-bb8a27542bcb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182769256" status: 202 len: 0 microversion: 2.1 time: 0.041221 Jul 18 14:25:38.070035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 417/848] 10.222.0.71 () {58 vars in 1220 bytes} [Mon Jul 18 14:25:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1182769256 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:25:38.121368 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:38.130850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-26d650f1-a976-4c42-8ecd-3040d2b4e0cc tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1547 microversion: 2.1 time: 0.196831 Jul 18 14:25:38.131559 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 432/849] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:37 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1547 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:38.150079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:38.150572 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:38.159046 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.160401 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.161360 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.161837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.291349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5644bf3a-ee18-4716-aed2-2ca30e406596 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146657 Jul 18 14:25:38.292048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 418/850] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:25:38 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:38.898392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-389028be-215a-4b62-9868-82777b62a345 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: .version_select at 0x7fb53a201af0>, body: {"keypair": {"name": "tempest-keypair-962466814", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRAChmUQZa4q/t3+1Omf+mD9u6Ba2QREPlQrU0q3KRSwtyzwlNYIlp4qAJVeOwpd2lzvzcyZevwo8x+pDf27gpxNwa52Y9ORmMzR+yXwZLKEoJYm7Z/K6qwQ2EpnxN2hQ=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:38.901794 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:38.903499 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:38.914328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-389028be-215a-4b62-9868-82777b62a345 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:25:38.915349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.916126 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.917635 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:38.918461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:38.919874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-389028be-215a-4b62-9868-82777b62a345 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:25:38.948493 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-389028be-215a-4b62-9868-82777b62a345 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053928 Jul 18 14:25:38.949874 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 419/851] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:25:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:39.224142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:39.246382 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:39.249325 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:39.251788 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c28f53e5-99f4-4bca-bd23-9e4d147e6ac5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1745 microversion: 2.20 time: 0.358525 Jul 18 14:25:39.253219 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 433/852] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:38 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1745 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:39.990709 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a577355b-542b-4fa2-b748-544ffd6193ab req-fb3996ad-d91e-47f1-976d-4ea6fd1a4ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fdc2f28-6e4e-4620-9ff1-3e41b54dae05", "tag": "5fb9cd92-9a41-4e68-91c0-0da02d9f33b8"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:40.000996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a577355b-542b-4fa2-b748-544ffd6193ab req-fb3996ad-d91e-47f1-976d-4ea6fd1a4ce6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:40.001602 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a577355b-542b-4fa2-b748-544ffd6193ab req-fb3996ad-d91e-47f1-976d-4ea6fd1a4ce6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:40.014328 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a577355b-542b-4fa2-b748-544ffd6193ab req-fb3996ad-d91e-47f1-976d-4ea6fd1a4ce6 service nova] Creating event network-changed:5fb9cd92-9a41-4e68-91c0-0da02d9f33b8 for instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 on hv-cinder-79760 Jul 18 14:25:40.019790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a577355b-542b-4fa2-b748-544ffd6193ab req-fb3996ad-d91e-47f1-976d-4ea6fd1a4ce6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032544 Jul 18 14:25:40.024698 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 420/853] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:40.272245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:40.273600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:40.280645 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:40.281627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:40.283035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:40.283665 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:40.673431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:40.685521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:40.691912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:40.697435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-497002cb-1ffd-4b94-afa4-09eafd30d068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1745 microversion: 2.20 time: 0.429315 Jul 18 14:25:40.699819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 434/854] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:40 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1745 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:40.899637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1023892407", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6c89027a-566a-4914-8ad9-bb014d7b4afd"}], "security_groups": [{"name": "tempest-securitygroup--1695699881"}], "key_name": "tempest-keypair-962466814", "user_data": "}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:41.095090 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] validate_networks() for [('6c89027a-566a-4914-8ad9-bb014d7b4afd', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:25:41.203198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-2bbe95a7-1d29-4877-82fc-361f87fd8b11 req-4a93e6c6-08a4-4b89-a5a5-df888627c3b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "name": "network-vif-plugged", "status": "completed", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:41.223268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2bbe95a7-1d29-4877-82fc-361f87fd8b11 req-4a93e6c6-08a4-4b89-a5a5-df888627c3b5 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:41.224358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-2bbe95a7-1d29-4877-82fc-361f87fd8b11 req-4a93e6c6-08a4-4b89-a5a5-df888627c3b5 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:41.240124 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-2bbe95a7-1d29-4877-82fc-361f87fd8b11 req-4a93e6c6-08a4-4b89-a5a5-df888627c3b5 service nova] Creating event network-vif-plugged:ecacf148-6e72-4653-b111-eaa9fa31984d for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b on hv-cinder-79760 Jul 18 14:25:41.247230 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-2bbe95a7-1d29-4877-82fc-361f87fd8b11 req-4a93e6c6-08a4-4b89-a5a5-df888627c3b5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048975 Jul 18 14:25:41.248533 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 435/855] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:41.723267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:41.724037 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:41.738017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:41.738487 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:41.739321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:41.739753 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:41.746565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:41.814325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:25:41.815038 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:25:41.815769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:25:41.816549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:25:41.817200 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:25:41.831549 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:41.832367 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:41.834613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:41.835288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:41.861067 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:25:41.867706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Getting quotas for user a0210f69010b4529822bcdac1bdf8b8a and project 94c7507618b247c98e6bb541a48dbd31. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:25:41.884519 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:25:41.888474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:25:41.950694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:41.961950 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-52eec4d8-948e-4678-8d06-f4e621e21987 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.066635 Jul 18 14:25:41.962970 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 421/856] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:25:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:25:41.977374 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:41.979042 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:41.986556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8c3b79e8-c8b7-410d-9895-283d2629a773 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.268458 Jul 18 14:25:41.989167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7e3f3b56-2e93-4a95-be89-e7ef640a8079 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:41.989683 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 436/857] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:41 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:41.990340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7e3f3b56-2e93-4a95-be89-e7ef640a8079 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:42.080309 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7e3f3b56-2e93-4a95-be89-e7ef640a8079 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:42.098714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7e3f3b56-2e93-4a95-be89-e7ef640a8079 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1241 microversion: 2.1 time: 0.119932 Jul 18 14:25:42.100477 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 422/858] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:41 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:43.007674 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:43.008653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:43.018546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:43.019312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:43.020120 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:43.020558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:43.118658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:43.119241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:43.128205 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:43.128552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:43.129763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:43.131122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:43.236619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:43.249045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-80ec67be-2f61-4cd2-aa9c-b851e3b7266b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1293 microversion: 2.1 time: 0.133589 Jul 18 14:25:43.256969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 423/859] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:43 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:43.309326 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:43.322833 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:43.340804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:43.346336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4b92d7bc-39a4-425c-ad65-7c3ebf382446 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.341548 Jul 18 14:25:43.357285 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 437/860] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:42 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:44.273263 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:44.274018 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:44.304665 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:44.306942 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:44.310235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:44.311484 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:44.367152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:44.367152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:44.390787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:44.391362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:44.392150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:44.392581 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:44.818678 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:44.831895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f8d8ddf2-6ede-49d3-b26b-983912db3a67 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.562428 Jul 18 14:25:44.832745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 424/861] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:44 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:44.888844 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:44.918614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:44.922293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:44.924464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d81bda60-fa0d-4c6f-9c74-3d231705c889 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.562584 Jul 18 14:25:44.925245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 438/862] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:44 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:45.672122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-c023a2c7-0275-4954-9d0a-b7846a7d2c32 req-ec07c58f-88c9-4524-a60b-797ae6a47018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9694e4df-0587-4cd9-8b22-0259d9c551cd", "tag": "32825ae0-1959-4368-9a80-fd1e53f403ad"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:45.707654 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-c023a2c7-0275-4954-9d0a-b7846a7d2c32 req-ec07c58f-88c9-4524-a60b-797ae6a47018 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:45.708336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-c023a2c7-0275-4954-9d0a-b7846a7d2c32 req-ec07c58f-88c9-4524-a60b-797ae6a47018 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:45.731893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-c023a2c7-0275-4954-9d0a-b7846a7d2c32 req-ec07c58f-88c9-4524-a60b-797ae6a47018 service nova] Creating event network-changed:32825ae0-1959-4368-9a80-fd1e53f403ad for instance 9694e4df-0587-4cd9-8b22-0259d9c551cd on hv-cinder-79760 Jul 18 14:25:45.742268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-c023a2c7-0275-4954-9d0a-b7846a7d2c32 req-ec07c58f-88c9-4524-a60b-797ae6a47018 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089761 Jul 18 14:25:45.749837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 425/863] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:45.864610 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:45.867154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:45.887916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:45.889349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:45.891120 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:45.892396 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:45.952141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:45.953364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:45.963111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:45.963594 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:45.964575 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:45.965008 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:46.689264 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:46.700745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9f7c3cce-7bdf-4ea8-b2ee-c2a32028eb00 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.852190 Jul 18 14:25:46.702015 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 439/864] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:45 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:46.748829 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:46.759423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:46.760956 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:46.762183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3bf73da1-57a5-497e-8d84-86612e7cbe8f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.815101 Jul 18 14:25:46.774138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 426/865] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:45 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:25:47.718532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:47.720049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:47.727130 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:47.727577 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:47.728366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:47.728791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:47.780557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:47.781349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:47.788988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:47.789928 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:47.794083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:47.795079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:48.117700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:48.123620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:48.139943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ede24566-de8b-4315-932e-0169e88c1ddb tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.425391 Jul 18 14:25:48.141629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:48.145445 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 440/866] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:47 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:48.148997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:48.150589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2c5ddda5-d59c-4228-8356-c316a971a72d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.373994 Jul 18 14:25:48.152705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 427/867] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:47 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:49.162723 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:49.163980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:49.170493 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:49.171036 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:49.171244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:49.172889 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:49.173270 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:49.173910 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:49.188009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:49.188604 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:49.190154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:49.191663 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:49.410943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:49.424424 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cb6181ee-0221-4585-a9a8-da7065a2a207 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.265010 Jul 18 14:25:49.426235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 441/868] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:49 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:25:49.445366 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:49.455498 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:49.469889 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:49.471429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-24361ee6-de82-42d7-9a06-39695143d2a0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.305481 Jul 18 14:25:49.472394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 428/869] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:49 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:50.443586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:50.444294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:50.451287 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:50.451965 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:50.453138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:50.453604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:50.491683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:50.492315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:50.502168 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:50.502632 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:50.503523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:50.503917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:50.531119 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=100 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:50.700016 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:50.711468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-69623de7-8aef-4675-8e8b-30a015906d23 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.271754 Jul 18 14:25:50.712950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 442/870] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:50 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:50.721456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:50.732939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:50.734795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:50.736704 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a063af28-5ef9-43f0-9904-b6b869812fff tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.250505 Jul 18 14:25:50.737503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 429/871] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:50 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:51.387154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-8f7f78f8-8e46-48a6-8b58-c905a5822bd7 req-6810cde9-c502-4335-af1e-7a9faaabf99b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9694e4df-0587-4cd9-8b22-0259d9c551cd", "name": "network-vif-plugged", "status": "completed", "tag": "32825ae0-1959-4368-9a80-fd1e53f403ad"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:51.399773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-8f7f78f8-8e46-48a6-8b58-c905a5822bd7 req-6810cde9-c502-4335-af1e-7a9faaabf99b service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:51.403420 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-8f7f78f8-8e46-48a6-8b58-c905a5822bd7 req-6810cde9-c502-4335-af1e-7a9faaabf99b service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:51.422937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-8f7f78f8-8e46-48a6-8b58-c905a5822bd7 req-6810cde9-c502-4335-af1e-7a9faaabf99b service nova] Creating event network-vif-plugged:32825ae0-1959-4368-9a80-fd1e53f403ad for instance 9694e4df-0587-4cd9-8b22-0259d9c551cd on hv-cinder-79760 Jul 18 14:25:51.480464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-8f7f78f8-8e46-48a6-8b58-c905a5822bd7 req-6810cde9-c502-4335-af1e-7a9faaabf99b service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096955 Jul 18 14:25:51.481401 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 443/872] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:25:51.728828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:51.730000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:51.761341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:51.762927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:51.763857 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:51.765648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:51.767400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:51.768526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:51.800995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:51.801860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:51.804110 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:51.808972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:51.844503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:52.076515 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:52.082434 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:52.091738 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-189f892c-38ae-4c59-9aac-744a518fec1d tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.366616 Jul 18 14:25:52.093213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:52.095256 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:52.096927 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f913c3d2-03dc-47d2-8c88-e3cc3ae8cac1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.345373 Jul 18 14:25:52.108115 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 444/873] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:51 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:52.108322 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 430/874] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:51 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:53.110655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:53.111211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:53.116257 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:53.116865 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:53.118871 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=12 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:53.120288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:53.120751 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:53.121831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:53.122258 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:53.124941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:53.125496 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:53.126300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:53.126729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:53.343443 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:53.346051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:53.353340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:53.354867 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:53.356518 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e20d7755-e57d-4801-bdc1-b86691c25806 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1740 microversion: 2.20 time: 0.244234 Jul 18 14:25:53.356674 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f00b2630-60f6-4095-bcba-f35c28da3a71 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1367 microversion: 2.1 time: 0.250125 Jul 18 14:25:53.357095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 431/875] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:53 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1740 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:53.357485 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 445/876] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:53 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1367 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:54.376004 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:54.377690 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:54.378777 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:54.379392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:54.387448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:54.388513 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:54.388931 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:54.389626 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:54.390114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:54.390969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:54.391198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:54.391902 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:54.615134 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:54.620979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:54.624662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-96fa19d0-2162-463b-ac2a-12bb2fceab09 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1557 microversion: 2.1 time: 0.253847 Jul 18 14:25:54.637598 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:54.638674 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 432/877] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:25:54 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1557 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:25:54.640575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:54.642244 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-98446073-b2fd-4e0f-8b1a-ff0a4faf1097 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1722 microversion: 2.20 time: 0.270298 Jul 18 14:25:54.643237 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 446/878] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:54 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1722 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:54.660182 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:54.660695 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:54.674270 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:54.674741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:54.675530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:54.675972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:54.768965 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1c370702-ba7a-4294-8c9e-8b01b6a9f157 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128996 Jul 18 14:25:54.769576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 433/879] 10.222.0.71 () {58 vars in 1274 bytes} [Mon Jul 18 14:25:54 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-interface => generated 285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:55.661390 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:55.662744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:55.670770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:55.671247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:55.672380 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:55.672822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:55.880965 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:55.891898 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:55.893450 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:55.894810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1cd766af-78e0-4dca-86d5-acea0e54eec1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1722 microversion: 2.20 time: 0.237254 Jul 18 14:25:55.895376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 447/880] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:55 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:56.052341 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-8185810a-9939-40a1-9e37-cc1476da300a req-5cfcfa72-60b0-433a-a031-55a11c28e28d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9694e4df-0587-4cd9-8b22-0259d9c551cd", "tag": "32825ae0-1959-4368-9a80-fd1e53f403ad"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:56.061729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-8185810a-9939-40a1-9e37-cc1476da300a req-5cfcfa72-60b0-433a-a031-55a11c28e28d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:56.062492 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-8185810a-9939-40a1-9e37-cc1476da300a req-5cfcfa72-60b0-433a-a031-55a11c28e28d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:56.076862 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-8185810a-9939-40a1-9e37-cc1476da300a req-5cfcfa72-60b0-433a-a031-55a11c28e28d service nova] Creating event network-changed:32825ae0-1959-4368-9a80-fd1e53f403ad for instance 9694e4df-0587-4cd9-8b22-0259d9c551cd on hv-cinder-79760 Jul 18 14:25:56.083797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-8185810a-9939-40a1-9e37-cc1476da300a req-5cfcfa72-60b0-433a-a031-55a11c28e28d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035273 Jul 18 14:25:56.084991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 434/881] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:25:56.920111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:56.922985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:56.942290 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:56.943688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:56.945521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:56.947798 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:57.190051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:57.199278 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:57.203612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:57.204836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f310972b-d392-4abe-996d-96ab9996d477 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1665 microversion: 2.20 time: 0.293909 Jul 18 14:25:57.205763 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 448/882] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:56 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1665 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:25:57.227128 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dcc750de-46f5-46eb-9a95-0d8cd3d8ffcf"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:57.231377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:57.241217 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:57.242383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:57.243544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:57.244246 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:57.274058 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-4a37db36-a54e-434d-b3c4-e90ef2315642 req-ff97cb7c-d5b9-49d2-a515-4b715b529db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "name": "network-vif-unplugged", "status": "completed", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:57.283291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4a37db36-a54e-434d-b3c4-e90ef2315642 req-ff97cb7c-d5b9-49d2-a515-4b715b529db5 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:57.283740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-4a37db36-a54e-434d-b3c4-e90ef2315642 req-ff97cb7c-d5b9-49d2-a515-4b715b529db5 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:57.298922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.compute.server_external_events [req-4a37db36-a54e-434d-b3c4-e90ef2315642 req-ff97cb7c-d5b9-49d2-a515-4b715b529db5 service nova] Unable to find a host for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b. Dropping event network-vif-unplugged {{(pid=117767) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 18 14:25:57.300351 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-4a37db36-a54e-434d-b3c4-e90ef2315642 req-ff97cb7c-d5b9-49d2-a515-4b715b529db5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030931 Jul 18 14:25:57.301621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 449/883] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:25:57 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 18 14:25:57.613133 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ebf50feb-70e1-4564-9993-8eb0c85a1068 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.394119 Jul 18 14:25:57.613959 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 435/884] 10.222.0.71 () {62 vars in 1363 bytes} [Mon Jul 18 14:25:57 2022] POST /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-volume_attachments => generated 188 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 18 14:25:57.741419 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:57.741946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:57.747983 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:57.748427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:57.749175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:57.749691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:58.001187 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cf8c5893-b5aa-4ac1-81af-a94a82f91bf7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-volume_attachments/dcc750de-46f5-46eb-9a95-0d8cd3d8ffcf" status: 202 len: 0 microversion: 2.20 time: 0.263499 Jul 18 14:25:58.002092 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 450/885] 10.222.0.71 () {60 vars in 1456 bytes} [Mon Jul 18 14:25:57 2022] DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-volume_attachments/dcc750de-46f5-46eb-9a95-0d8cd3d8ffcf => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:25:58.061854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:25:58.062557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:58.070010 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:58.070464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:58.071246 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:58.071694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:58.159622 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3c932454-6771-45e4-82da-f536f80cedaf tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "POST /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/action" status: 202 len: 0 microversion: 2.20 time: 0.101669 Jul 18 14:25:58.160412 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 436/886] 10.222.0.71 () {62 vars in 1318 bytes} [Mon Jul 18 14:25:58 2022] POST /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:25:58.168946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:58.169557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:58.177100 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:58.177866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:58.179473 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:58.180152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:58.328563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:58.331102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:25:58.338912 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:58.340414 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:58.341673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fa2e2adf-4cfb-4424-8b93-f1d767db45ee tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1673 microversion: 2.20 time: 0.177016 Jul 18 14:25:58.342404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 451/887] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:58 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:25:59.362338 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:25:59.362968 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:25:59.369860 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:59.370306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:59.371076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:25:59.371508 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:25:59.526397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:59.536463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:59.538007 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:25:59.539178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-20537279-4a0f-4d2f-b2eb-073addbc6cdb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1673 microversion: 2.20 time: 0.182056 Jul 18 14:25:59.539775 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 437/888] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:25:59 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:00.559675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:00.560249 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:00.568028 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:00.568475 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:00.569247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:00.569701 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:00.714005 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:00.723946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:00.725454 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:00.726647 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-218d5929-f491-4bfa-89a4-31621b89322f tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1673 microversion: 2.20 time: 0.171058 Jul 18 14:26:00.727219 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 452/889] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:00 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:01.748700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:01.749553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:01.756646 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:01.757107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:01.757916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:01.758351 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:01.900059 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:01.909387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:01.911043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:01.912274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e62313b0-f830-4bcb-bbb7-2ea760314de6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1675 microversion: 2.20 time: 0.170135 Jul 18 14:26:01.912791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 438/890] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:01 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:02.932272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:02.932752 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:02.934823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:02.941127 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:02.941573 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:02.942376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:02.942825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:03.268526 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:03.277166 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:03.278693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:03.279934 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-74222167-2b5b-441a-84c9-1d60f3f5b6be tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.351928 Jul 18 14:26:03.280540 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 453/891] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:02 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:04.298714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:04.299333 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:04.301888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:04.308797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:04.309453 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:04.310607 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:04.311102 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:04.462290 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:04.471458 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:04.472961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:04.474169 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eacc5635-ccde-4617-92fc-4fe4e438bf79 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.179516 Jul 18 14:26:04.474705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 439/892] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:04 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:05.497769 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:05.498316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:05.505829 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:05.506281 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:05.507056 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:05.507486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:05.656482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:05.665493 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:05.667020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:05.668179 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-072d51eb-b0c8-49bd-8359-320edf1dfd39 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.174551 Jul 18 14:26:05.668696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 454/893] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:05 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:06.692557 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:06.693388 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:06.700302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:06.700755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:06.701545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:06.702010 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:06.873545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:06.884419 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:06.886668 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:06.888974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ddaf9aae-c368-4f19-8334-86b440e34331 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.200190 Jul 18 14:26:06.893491 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 440/894] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:06 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:26:07.910020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:07.910585 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:07.917754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:07.918247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:07.919062 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:07.919498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:08.078918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:08.088004 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:08.090885 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:08.092945 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-caff8164-65a2-4a23-bc98-fd8e98319a93 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.187649 Jul 18 14:26:08.094126 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 455/895] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:07 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:26:09.120074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:09.120922 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:09.128497 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:09.128949 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:09.129809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:09.130281 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:09.282872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:09.293250 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:09.295661 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:09.297241 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d461234d-7a41-4d8c-aa71-83f70032841c tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.181155 Jul 18 14:26:09.299554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 441/896] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:09 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:10.318939 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:10.319685 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:10.326508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:10.326926 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:10.328472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:10.328905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:10.470982 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:10.480097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:10.481711 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:10.482896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3264abcd-22fd-4c41-9ae6-b0b04f5a940b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.168661 Jul 18 14:26:10.483450 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 456/897] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:10 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:11.502677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:11.503237 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:11.510048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:11.510806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:11.511811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:11.512247 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:11.658587 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:11.668073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:11.674305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:11.675645 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-796652bd-cfeb-4e30-83b9-b82303296bc7 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.177220 Jul 18 14:26:11.685746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 442/898] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:11 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:12.694614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:12.695257 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:12.702429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:12.702813 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:12.703611 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:12.704046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:12.844517 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:12.852891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:12.854415 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:12.855579 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ce3c6af7-9760-423e-ab39-fa571df1bb7b tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.165029 Jul 18 14:26:12.856132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 457/899] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:12 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:13.874815 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:13.875386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:13.882866 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:13.883312 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:13.884080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:13.884512 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:13.905093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:14.036365 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:14.044715 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:14.046999 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:14.048578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-13440db8-26ef-4486-86d3-235845b8c53e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.177836 Jul 18 14:26:14.049154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 443/900] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:13 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:15.069116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:15.070598 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:15.081167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:15.081167 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:15.081643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:15.081914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:15.232142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:15.242304 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:15.244155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:15.245518 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-44703e12-1379-47e0-b2d4-46b0a4b9ffa1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.181662 Jul 18 14:26:15.246093 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 458/901] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:15 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:16.265601 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:16.266268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:16.272837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:16.273306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:16.274104 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:16.274541 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:16.586974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:16.600077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:16.602338 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:16.603868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fb2d3bb4-5e6f-4b86-9874-0bc45f322572 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.342262 Jul 18 14:26:16.604596 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 444/902] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:16 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:17.628386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:17.628971 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:17.636332 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:17.636787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:17.637621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:17.638084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:17.775713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:17.783890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:17.785384 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:17.786584 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-832eff1c-0bac-41ef-9317-fa321c66e6ab tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.162208 Jul 18 14:26:17.787120 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 459/903] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:17 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:18.808660 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:18.809996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:18.823837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:18.824892 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:18.826992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:18.827806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:18.975452 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:18.985268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:18.986818 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:18.987997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-79574e8c-eb15-4b69-a996-b93f1973787e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.187176 Jul 18 14:26:18.988552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 445/904] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:18 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:19.358220 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-669baea6-09b8-4d31-b01a-4c57fc3c66ba req-f75f8707-ab21-4197-bafa-1439ea292ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "name": "network-vif-plugged", "status": "completed", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:19.372768 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-669baea6-09b8-4d31-b01a-4c57fc3c66ba req-f75f8707-ab21-4197-bafa-1439ea292ee4 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:19.373570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-669baea6-09b8-4d31-b01a-4c57fc3c66ba req-f75f8707-ab21-4197-bafa-1439ea292ee4 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:19.388840 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-669baea6-09b8-4d31-b01a-4c57fc3c66ba req-f75f8707-ab21-4197-bafa-1439ea292ee4 service nova] Creating event network-vif-plugged:ecacf148-6e72-4653-b111-eaa9fa31984d for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b on hv-cinder-79760 Jul 18 14:26:19.394688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-669baea6-09b8-4d31-b01a-4c57fc3c66ba req-f75f8707-ab21-4197-bafa-1439ea292ee4 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041281 Jul 18 14:26:19.395890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 460/905] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:20.007401 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:20.008058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:20.020197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:20.020197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:20.020197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:20.020197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:20.164227 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:20.175420 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:20.177552 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:20.179385 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7cf021b6-2ecc-4d6f-af70-af7ea6a6f0f9 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.175854 Jul 18 14:26:20.180190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 446/906] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:20 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:21.201295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:21.202446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:21.208797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:21.209237 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:21.210062 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:21.210455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:21.354793 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:21.363383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:21.364872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:21.366055 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ba69fd1b-1ac4-4424-9830-1e424893261e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1731 microversion: 2.20 time: 0.169516 Jul 18 14:26:21.366742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 461/907] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:21 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:22.385592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:22.386187 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:22.393503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:22.393983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:22.394735 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:22.395171 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:22.539453 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:22.551117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:22.553344 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:22.555161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4df34798-e54e-4b43-8891-aaa009642a1d tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1718 microversion: 2.20 time: 0.173268 Jul 18 14:26:22.555769 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 447/908] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:26:22 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:26:26.675692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-184392210", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "networks": [{"uuid": "8dca2d4a-0d6e-4b38-94e6-70ab1b1195f3"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:26.731142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] validate_networks() for [('8dca2d4a-0d6e-4b38-94e6-70ab1b1195f3', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:26:27.050861 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:27.051481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:27.061866 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:27.062413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:27.063250 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:27.063774 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:27.088654 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-32549225-e2a1-412b-b66e-7954f782d426 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/ips" status: 200 len: 145 microversion: 2.1 time: 0.041937 Jul 18 14:26:27.089221 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 448/909] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:26:27 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:27.151206 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:26:27.151553 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:26:27.152023 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:26:27.152465 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:26:27.152868 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:26:27.163235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:27.163680 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:27.164469 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:27.164899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:27.182849 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Getting quotas for project 3e1451a6c59a4ef0b0cfe3cc6b98c605. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:26:27.187722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Getting quotas for user b750b0c7df7f4cee94b5b4d578f601b0 and project 3e1451a6c59a4ef0b0cfe3cc6b98c605. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:26:27.198995 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:26:27.201245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:26:27.248672 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-123e324b-8687-4318-956d-a77340c943c9 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.577699 Jul 18 14:26:27.254867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 462/910] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:26:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 580 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 14:26:27.260284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6747681c-1810-4faf-b473-c716a0dc2cce tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:27.261081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6747681c-1810-4faf-b473-c716a0dc2cce tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:27.322556 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6747681c-1810-4faf-b473-c716a0dc2cce tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:27.330301 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6747681c-1810-4faf-b473-c716a0dc2cce tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1213 microversion: 2.1 time: 0.073963 Jul 18 14:26:27.331237 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 449/911] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:27 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:26:28.356515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:28.357214 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:28.365183 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:28.365600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:28.366498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:28.366927 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:28.459584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41b5323a-e16d-47b3-bc92-7942a6f433f5"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:28.461647 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:28.472658 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:28.473983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:28.475556 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:28.477346 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:28.769838 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:28.779029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ed2e0786-fbe2-4dd2-a5a6-f436bc091a33 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1273 microversion: 2.1 time: 0.432153 Jul 18 14:26:28.779642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 463/912] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:28 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1273 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:28.902891 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5a5092ca-adde-4dbf-9430-cbdde0ffc11a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.447635 Jul 18 14:26:28.908843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 450/913] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:26:28 2022] POST /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments => generated 194 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:26:29.796638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:29.797268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:29.804255 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:29.804709 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:29.805494 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:29.805972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:30.057392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:30.065883 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9f36c16e-5be0-470e-805b-0326c4a57fbc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.273189 Jul 18 14:26:30.066458 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 464/914] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:29 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:30.227949 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-24b81ce2-75cb-4785-9a97-68fa2e017d9a req-86f70d7d-6072-4035-82a2-dfdac939ba99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a02ec9c6-5c26-449c-b4cb-5d100cfea8ad", "tag": "69f8ef41-bc6e-475d-bc80-f375c37141a5"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:30.237853 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-24b81ce2-75cb-4785-9a97-68fa2e017d9a req-86f70d7d-6072-4035-82a2-dfdac939ba99 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:30.238394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-24b81ce2-75cb-4785-9a97-68fa2e017d9a req-86f70d7d-6072-4035-82a2-dfdac939ba99 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:30.250329 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-24b81ce2-75cb-4785-9a97-68fa2e017d9a req-86f70d7d-6072-4035-82a2-dfdac939ba99 service nova] Creating event network-changed:69f8ef41-bc6e-475d-bc80-f375c37141a5 for instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad on hv-cinder-79760 Jul 18 14:26:30.255974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-24b81ce2-75cb-4785-9a97-68fa2e017d9a req-86f70d7d-6072-4035-82a2-dfdac939ba99 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032628 Jul 18 14:26:30.256678 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 451/915] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:31.086918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:31.088542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:31.099822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:31.100465 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:31.101723 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:31.102188 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:31.105107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=72 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:31.248020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:31.259553 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-488befa7-d077-4dcb-a946-8081d08f9afc tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.179823 Jul 18 14:26:31.260324 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 465/916] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:31 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:32.279074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:32.279846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:32.286891 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:32.287340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:32.288102 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:32.288533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:32.441841 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:32.450159 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3ccce925-6536-4233-affd-a6e04cd72e68 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.175760 Jul 18 14:26:32.450728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 452/917] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:32 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:33.468305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:33.468948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:33.471184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:33.477515 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:33.478341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:33.478953 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:33.479407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:33.628919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:33.637352 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6f8d33c0-acac-4946-9791-25ecb6a83dcf tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.173883 Jul 18 14:26:33.637935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 466/918] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:33 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:34.654980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:34.655563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:34.658122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=30 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:34.664035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:34.664487 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:34.665268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:34.665730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:34.814932 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:34.823207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2ba522fc-f054-4bd0-99bb-3f907eea63aa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.172284 Jul 18 14:26:34.823773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 453/919] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:34 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:35.434017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-03fd3c7e-1c7a-4d2f-b5a9-32c61384dba8 req-fa550228-1ce3-43bb-a67f-edd815e17718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02ec9c6-5c26-449c-b4cb-5d100cfea8ad", "name": "network-vif-plugged", "status": "completed", "tag": "69f8ef41-bc6e-475d-bc80-f375c37141a5"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:35.443427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-03fd3c7e-1c7a-4d2f-b5a9-32c61384dba8 req-fa550228-1ce3-43bb-a67f-edd815e17718 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:35.443837 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-03fd3c7e-1c7a-4d2f-b5a9-32c61384dba8 req-fa550228-1ce3-43bb-a67f-edd815e17718 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:35.458133 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-03fd3c7e-1c7a-4d2f-b5a9-32c61384dba8 req-fa550228-1ce3-43bb-a67f-edd815e17718 service nova] Creating event network-vif-plugged:69f8ef41-bc6e-475d-bc80-f375c37141a5 for instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad on hv-cinder-79760 Jul 18 14:26:35.464693 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-03fd3c7e-1c7a-4d2f-b5a9-32c61384dba8 req-fa550228-1ce3-43bb-a67f-edd815e17718 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034436 Jul 18 14:26:35.465282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 467/920] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:35.841083 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:35.841722 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:35.848685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:35.849163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:35.849973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:35.850400 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:36.006474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:36.014011 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1346183b-b455-4c1c-bae0-d83c2f98ab31 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.176998 Jul 18 14:26:36.014567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 454/921] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:35 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:36.479262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:36.480250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:36.487686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:36.488177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:36.488866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:36.489294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:36.520558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-650e6067-2910-4d03-8592-f8c45904a813 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046721 Jul 18 14:26:36.521025 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 468/922] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:36 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:36.531680 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:36.532174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:36.538494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:36.538936 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:36.539690 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:36.540114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:36.569024 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8d5c916c-1eb1-4bed-975e-07b04e7c60bb tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/41b5323a-e16d-47b3-bc92-7942a6f433f5" status: 200 len: 194 microversion: 2.1 time: 0.041634 Jul 18 14:26:36.569589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 455/923] 10.222.0.71 () {58 vars in 1412 bytes} [Mon Jul 18 14:26:36 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/41b5323a-e16d-47b3-bc92-7942a6f433f5 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:37.036155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:37.036673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:37.043027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:37.043480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:37.044250 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:37.044754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:37.173599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:37.185305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:37.194040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-40f33ba3-caf0-47b8-be16-404411349411 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1313 microversion: 2.1 time: 0.161829 Jul 18 14:26:37.194863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 469/924] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:37 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:37.927150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21456871-a13d-43e3-8139-d22852a340b7"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:37.928130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:37.930533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:37.937188 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:37.937642 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:37.938443 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:37.938889 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.211500 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:38.212119 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:38.212215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5d6e26be-3981-4aa7-9765-0587e28a9d9a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "POST /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288975 Jul 18 14:26:38.212941 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 456/925] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:26:37 2022] POST /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:38.215462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:38.222168 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:38.222798 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.224002 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:38.225069 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.385424 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:38.394886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f46fde3f-2715-45f1-a8ee-87396b4d1720 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1498 microversion: 2.1 time: 0.187340 Jul 18 14:26:38.395519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 470/926] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:38 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1498 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:38.880683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:38.881265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:38.888364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:38.888992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.890389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:38.891043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:38.928888 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:26:38.982193 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:39.015772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-783907c2-f837-434c-93d2-077241866474 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 204 len: 0 microversion: 2.1 time: 0.136801 Jul 18 14:26:39.015772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 457/927] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:26:38 2022] DELETE /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:26:39.024821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:39.025429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:39.032147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:39.032564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:39.033342 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:39.033811 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:39.171794 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:39.181433 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-82d4a071-c65a-488d-a905-f3403679d85d tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1504 microversion: 2.1 time: 0.160626 Jul 18 14:26:39.182207 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 471/928] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:39 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:40.200566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:40.202013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:40.208671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:40.209098 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:40.209907 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:40.210365 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:40.374787 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:40.389279 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eaf8a05e-f405-4c76-b5a5-fcf8b9ab0739 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1504 microversion: 2.1 time: 0.192326 Jul 18 14:26:40.390173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 458/929] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:40 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1504 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:40.925146 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:40.925784 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:40.932696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:40.932941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:40.933737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:40.934186 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:40.959771 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-aaf62eb8-6c5e-48ef-8708-ab74d44dff65 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/ips" status: 200 len: 150 microversion: 2.1 time: 0.038510 Jul 18 14:26:40.960359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 472/930] 10.222.0.71 () {58 vars in 1247 bytes} [Mon Jul 18 14:26:40 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:41.194398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-2c5641e0-d86e-4fb4-ad85-3ef1a2e6a9e9 req-54f7102c-16b3-4e9e-a573-c7dd11b05ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a02ec9c6-5c26-449c-b4cb-5d100cfea8ad", "name": "network-vif-deleted", "tag": "69f8ef41-bc6e-475d-bc80-f375c37141a5"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:41.217310 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2c5641e0-d86e-4fb4-ad85-3ef1a2e6a9e9 req-54f7102c-16b3-4e9e-a573-c7dd11b05ba5 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:41.218048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-2c5641e0-d86e-4fb4-ad85-3ef1a2e6a9e9 req-54f7102c-16b3-4e9e-a573-c7dd11b05ba5 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:41.231583 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-2c5641e0-d86e-4fb4-ad85-3ef1a2e6a9e9 req-54f7102c-16b3-4e9e-a573-c7dd11b05ba5 service nova] Creating event network-vif-deleted:69f8ef41-bc6e-475d-bc80-f375c37141a5 for instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad on hv-cinder-79760 Jul 18 14:26:41.240537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-2c5641e0-d86e-4fb4-ad85-3ef1a2e6a9e9 req-54f7102c-16b3-4e9e-a573-c7dd11b05ba5 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053381 Jul 18 14:26:41.241637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 459/931] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:26:41.412865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:41.413471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:41.420189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:41.420604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:41.421400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:41.421874 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:41.455423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:41.455847 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:41.456303 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lazy-loading 'fault' on Instance uuid a02ec9c6-5c26-449c-b4cb-5d100cfea8ad {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:26:41.503685 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:41.513023 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-04de1a8a-a077-4b37-a4d3-667fd0e51615 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 200 len: 1303 microversion: 2.1 time: 0.104051 Jul 18 14:26:41.513775 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 473/932] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:41 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 1303 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:42.399337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c4131c01-17ec-4af6-afe6-929713d75767"}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:42.400479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:42.406980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:42.407432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:42.408218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:42.408650 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:42.542067 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:42.542934 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: a02ec9c6-5c26-449c-b4cb-5d100cfea8ad] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:42.553756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:42.553756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:42.553756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:42.553756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:42.567154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] HTTP exception thrown: Instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad could not be found. Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Request method failure captured: Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad HTTP/1.1 Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1W2Q23G9pyROr8x0RuTvO6mQVQwpiPZ57avfgtCFqkLdfGqfDMBLAioS3vC3YcJr1T3PDG-UrS6cn7DP4W5VQ97Wgi1PM9-Yk4phhIO2dbig5Yfxi16Ndt9ZhA0jXWde3EC-nEYPKWGd1p5LYLEhQZHus0P1GQ9gGohkxlIT24fWuNQ Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 3e1451a6c59a4ef0b0cfe3cc6b98c605 Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesActionsTest-1259292203 Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:26:42.568881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/3e1451a6c59a4ef0b0cfe3cc6b98c605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3e1451a6c59a4ef0b0cfe3cc6b98c605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3e1451a6c59a4ef0b0cfe3cc6b98c605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_3e1451a6c59a4ef0b0cfe3cc6b98c605", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesActionsTest-1259292203 Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 3e1451a6c59a4ef0b0cfe3cc6b98c605 Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesActionsTest-1259292203 Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesActionsTest-1259292203-project Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: b750b0c7df7f4cee94b5b4d578f601b0 Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesActionsTest-1259292203-project Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad could not be found. Jul 18 14:26:42.571394 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'a02ec9c6-5c26-449c-b4cb-5d100cfea8ad'} Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad could not be found. Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:26:42.575149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad could not be found. Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad could not be found. Jul 18 14:26:42.580402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:26:42.581737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Returning 404 to user: Instance a02ec9c6-5c26-449c-b4cb-5d100cfea8ad could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:26:42.581737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3a0b8e99-39a8-417b-b25c-ae4c67f399c8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad" status: 404 len: 111 microversion: 2.1 time: 0.040498 Jul 18 14:26:42.581737 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 474/933] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:42 2022] GET /compute/v2.1/servers/a02ec9c6-5c26-449c-b4cb-5d100cfea8ad => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:26:42.624534 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1667820286", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452", "networks": [{"uuid": "8dca2d4a-0d6e-4b38-94e6-70ab1b1195f3"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:42.689328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] validate_networks() for [('8dca2d4a-0d6e-4b38-94e6-70ab1b1195f3', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:26:42.729914 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-dfdb818b-9d00-4fdb-89f3-9c05ee35d468 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "POST /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335168 Jul 18 14:26:42.730566 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 460/934] 10.222.0.71 () {60 vars in 1322 bytes} [Mon Jul 18 14:26:42 2022] POST /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:43.120316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:26:43.120743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:26:43.121215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:26:43.121696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:26:43.122093 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:26:43.132291 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:43.132746 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:43.133793 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:43.134251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:43.152676 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Getting quotas for project 3e1451a6c59a4ef0b0cfe3cc6b98c605. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:26:43.157282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Getting quotas for user b750b0c7df7f4cee94b5b4d578f601b0 and project 3e1451a6c59a4ef0b0cfe3cc6b98c605. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:26:43.168605 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:26:43.171045 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:26:43.217828 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c4b2c845-49c8-4b02-a5bf-90962ce54346 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597598 Jul 18 14:26:43.218447 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 475/935] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 18 14:26:43.230049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bdbce088-4670-4a16-8dfc-54a42222d58a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:43.230845 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bdbce088-4670-4a16-8dfc-54a42222d58a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:43.289567 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bdbce088-4670-4a16-8dfc-54a42222d58a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:43.296477 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bdbce088-4670-4a16-8dfc-54a42222d58a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1214 microversion: 2.1 time: 0.071529 Jul 18 14:26:43.297352 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 461/936] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:43 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:44.314830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:44.315431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:44.322865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:44.323317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:44.324102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:44.324537 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:44.393301 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:44.401448 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b76c9618-427d-425c-94a2-8563f8986d1c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1266 microversion: 2.1 time: 0.091352 Jul 18 14:26:44.402064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 476/937] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:44 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:45.419925 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:45.420948 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:45.428571 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.429149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.430042 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.430554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.513914 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:45.523307 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-877d8ae3-640f-4a6d-b5ac-6df7238004af tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1272 microversion: 2.1 time: 0.107668 Jul 18 14:26:45.524065 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 462/938] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:45 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:45.818715 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:45.820525 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:45.832547 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.833149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.834533 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:45.835437 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:45.875911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7047e0bc-3b8c-42f4-ac93-eeccecee5db0 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.064917 Jul 18 14:26:45.876368 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 477/939] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:45 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments => generated 371 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:46.024160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:46.024961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:46.034530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.034983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.035822 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.036261 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.072575 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bd739cdc-35db-4502-a9c8-7a4700eb413e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/41b5323a-e16d-47b3-bc92-7942a6f433f5" status: 200 len: 194 microversion: 2.1 time: 0.055475 Jul 18 14:26:46.073239 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 463/940] 10.222.0.71 () {58 vars in 1412 bytes} [Mon Jul 18 14:26:46 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/41b5323a-e16d-47b3-bc92-7942a6f433f5 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:46.087881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:46.088882 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:46.102356 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.103274 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.106078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.106900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.262865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lazy-loading 'services' on Instance uuid 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:26:46.353208 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3b8e0605-2615-4d62-a8a6-700e8f3f4865 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/41b5323a-e16d-47b3-bc92-7942a6f433f5" status: 202 len: 0 microversion: 2.1 time: 0.272964 Jul 18 14:26:46.353830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 478/941] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:26:46 2022] DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/41b5323a-e16d-47b3-bc92-7942a6f433f5 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:26:46.547700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:46.556662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:46.567920 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.568590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.569740 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.570318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.773772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:46.783629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-71f33d8e-1d16-4167-81ee-f1a0f23c3711 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1314 microversion: 2.1 time: 0.243422 Jul 18 14:26:46.784260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 464/942] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:46 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:46.898755 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-da37d47c-1725-46e6-96eb-a151b8c913be req-32dd6004-8dca-4ad4-bdad-f2f4598bee36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "35c2b8f0-7c28-4278-88fe-ec2c392ce7c5", "tag": "45d8d52e-460d-4431-b7c9-86df07a543ed"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:46.917049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-da37d47c-1725-46e6-96eb-a151b8c913be req-32dd6004-8dca-4ad4-bdad-f2f4598bee36 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:46.917890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-da37d47c-1725-46e6-96eb-a151b8c913be req-32dd6004-8dca-4ad4-bdad-f2f4598bee36 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:46.942435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-da37d47c-1725-46e6-96eb-a151b8c913be req-32dd6004-8dca-4ad4-bdad-f2f4598bee36 service nova] Creating event network-changed:45d8d52e-460d-4431-b7c9-86df07a543ed for instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 on hv-cinder-79760 Jul 18 14:26:46.948928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-da37d47c-1725-46e6-96eb-a151b8c913be req-32dd6004-8dca-4ad4-bdad-f2f4598bee36 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056008 Jul 18 14:26:46.950586 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 479/943] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:47.801128 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:47.801754 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:47.808394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:47.808843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:47.809686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:47.810116 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:47.955772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:47.963645 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6d955f1d-3491-44d1-9c3f-8bbfc92e003a tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1314 microversion: 2.1 time: 0.166355 Jul 18 14:26:47.964198 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 465/944] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:47 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:48.981881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:48.982619 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:48.990215 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:48.990651 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:48.991417 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:48.991859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:49.134405 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:49.143164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4a679397-aae8-44e2-8178-3e7cdaeb0abd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1314 microversion: 2.1 time: 0.166191 Jul 18 14:26:49.143738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 480/945] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:48 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:50.161110 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:50.161762 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:50.169122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:50.169607 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:50.170883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:50.171350 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:50.312191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:50.320854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fe5d754a-596d-4014-b12f-83a5d2e61dde tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1314 microversion: 2.1 time: 0.164003 Jul 18 14:26:50.321430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 466/946] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:50 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:51.339292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:51.340276 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:51.347581 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:51.348551 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:51.349875 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:51.350686 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:51.551025 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-5596deae-4dcd-454b-bab7-e4bdd9523800 req-18ab95ed-7b03-413d-8b9a-c89bf605cecd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c2b8f0-7c28-4278-88fe-ec2c392ce7c5", "name": "network-vif-plugged", "status": "completed", "tag": "45d8d52e-460d-4431-b7c9-86df07a543ed"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:51.564833 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5596deae-4dcd-454b-bab7-e4bdd9523800 req-18ab95ed-7b03-413d-8b9a-c89bf605cecd service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:51.565677 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5596deae-4dcd-454b-bab7-e4bdd9523800 req-18ab95ed-7b03-413d-8b9a-c89bf605cecd service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:51.579068 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-5596deae-4dcd-454b-bab7-e4bdd9523800 req-18ab95ed-7b03-413d-8b9a-c89bf605cecd service nova] Creating event network-vif-plugged:45d8d52e-460d-4431-b7c9-86df07a543ed for instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 on hv-cinder-79760 Jul 18 14:26:51.583715 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:51.584498 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-5596deae-4dcd-454b-bab7-e4bdd9523800 req-18ab95ed-7b03-413d-8b9a-c89bf605cecd service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038935 Jul 18 14:26:51.585109 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 467/947] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:26:51.593387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7b3ee215-e2c8-4aa7-95ac-aa620859d4bd tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1314 microversion: 2.1 time: 0.258078 Jul 18 14:26:51.594047 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 481/948] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:51 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:52.573903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.574599 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.581757 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.582214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.583016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.583456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.618831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.619592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.628158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.628980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.630005 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.630464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.690966 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lazy-loading 'services' on Instance uuid 9694e4df-0587-4cd9-8b22-0259d9c551cd {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:26:52.797729 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5efcece4-0892-4fc1-a8fa-0bae490d4d8b tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments/c4131c01-17ec-4af6-afe6-929713d75767" status: 202 len: 0 microversion: 2.1 time: 0.227217 Jul 18 14:26:52.799291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 468/949] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:26:52 2022] DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments/c4131c01-17ec-4af6-afe6-929713d75767 => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:26:52.814001 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.814545 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:52.816553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.824560 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c77fc156-4069-4cce-8d17-708d53478973 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1314 microversion: 2.1 time: 0.209552 Jul 18 14:26:52.825761 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 482/950] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:52 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:26:52.828708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.829649 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.830946 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.831510 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.847051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.847558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.854265 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.854725 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.855542 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.856157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.877894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c0ab33a0-2e1f-4bfd-a6c6-6485f1db7d60 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071928 Jul 18 14:26:52.878620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 469/951] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:52 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:52.884881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:52.893594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7bd69f2b-85e3-4d0c-b1be-c1ff803eb439 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/21456871-a13d-43e3-8139-d22852a340b7" status: 200 len: 194 microversion: 2.1 time: 0.050699 Jul 18 14:26:52.894359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 483/952] 10.222.0.71 () {58 vars in 1412 bytes} [Mon Jul 18 14:26:52 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/21456871-a13d-43e3-8139-d22852a340b7 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:26:52.905872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:52.906385 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:52.912936 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.913418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:52.914253 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:52.914694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.005202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lazy-loading 'services' on Instance uuid 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:26:53.083904 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a03bbc9c-94f4-419e-99c5-8c77e9b5af9f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/21456871-a13d-43e3-8139-d22852a340b7" status: 202 len: 0 microversion: 2.1 time: 0.182746 Jul 18 14:26:53.084502 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 470/953] 10.222.0.71 () {58 vars in 1415 bytes} [Mon Jul 18 14:26:52 2022] DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments/21456871-a13d-43e3-8139-d22852a340b7 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:26:53.844236 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:53.844950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:53.846968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:53.847647 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:53.855094 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:53.855554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.856356 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:53.856821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.892481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:53.893530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:53.895983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:53.903405 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:53.903860 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.905121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:53.905887 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:53.941168 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4d1e67fe-0caf-4bcd-bbe3-8f9052eaf3f1 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054346 Jul 18 14:26:53.942092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 471/954] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:53 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:26:54.019837 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:54.028162 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-486fd729-9e12-4a41-a671-e2d87dfce22c tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1498 microversion: 2.1 time: 0.188409 Jul 18 14:26:54.028753 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 484/955] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:53 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1498 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:54.610226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:54.611093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:54.621684 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.622482 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.623883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.624676 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.664860 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:26:54.717501 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:26:54.759263 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b3dd94b7-313e-46fb-8800-7e7a96eb6033 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "DELETE /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 204 len: 0 microversion: 2.1 time: 0.157106 Jul 18 14:26:54.759822 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 472/956] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:26:54 2022] DELETE /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:26:54.769797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:54.770421 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:54.776892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.777336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.778163 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.778600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.955026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:54.956480 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:54.969116 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.969879 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.970353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:54.971214 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:54.971916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:54.982866 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e552c770-f4d7-4f50-823b-753624c7f6bb tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1504 microversion: 2.1 time: 0.217225 Jul 18 14:26:54.984429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 485/957] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:54 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1504 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:55.011129 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-66d9ec3b-b6ce-43b4-91ea-9ad5af469f4c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061402 Jul 18 14:26:55.011603 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 473/958] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:54 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 18 14:26:55.074430 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:55.074944 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:55.081719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.082180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.082977 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.083420 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.111919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:26:55.208376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ff603e2a-8a29-40e1-a7be-edb916387636 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 204 len: 0 microversion: 2.1 time: 0.137509 Jul 18 14:26:55.209091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 486/959] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:26:55 2022] DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:26:55.218264 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:55.219076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:55.225757 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.226211 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.227005 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:55.227445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:55.406287 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:55.414806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fbbfecd4-b7ca-4223-956e-8b69decde730 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1682 microversion: 2.1 time: 0.200841 Jul 18 14:26:55.415367 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 474/960] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:55 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1682 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:56.003462 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:56.004184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:56.011742 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:56.012199 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:56.013004 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:56.013446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:56.184029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:56.194283 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2b64129a-f29a-4a89-bd08-2d61a05688a8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1504 microversion: 2.1 time: 0.195858 Jul 18 14:26:56.194909 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 487/961] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:55 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1504 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:56.435564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:56.436456 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:56.446097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:56.446577 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:56.447745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:56.448501 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:56.597703 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:56.606115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33b8a66d-173a-4854-bac2-45ffb8dae989 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1682 microversion: 2.1 time: 0.176288 Jul 18 14:26:56.606709 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 475/962] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:56 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1682 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:57.212920 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:57.213554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:57.222544 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:57.222988 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:57.223764 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:57.224190 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:57.625800 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:57.626503 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:57.636402 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:57.636849 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:57.637636 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:57.638108 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:57.664053 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:57.672818 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f9e434df-b8d4-4497-aa61-8c9fe610afe8 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1504 microversion: 2.1 time: 0.463737 Jul 18 14:26:57.673403 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 488/963] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:57 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:57.781340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:57.789529 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7f203f2c-7575-4904-9933-051c63f4bb5e tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1682 microversion: 2.1 time: 0.168535 Jul 18 14:26:57.790151 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 476/964] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:57 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:26:58.563020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:58.564381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:58.577407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.578149 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.579484 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.580267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.617112 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4bb0f115-3148-49ad-9a02-c22f0577d67c tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064712 Jul 18 14:26:58.620988 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 489/965] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:58 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:26:58.638230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-a595608e-0b89-4fcb-9498-2de7522267e2 req-b34845a3-7904-4b18-aaff-d478af9d635c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "35c2b8f0-7c28-4278-88fe-ec2c392ce7c5", "name": "network-vif-deleted", "tag": "45d8d52e-460d-4431-b7c9-86df07a543ed"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:58.647112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a595608e-0b89-4fcb-9498-2de7522267e2 req-b34845a3-7904-4b18-aaff-d478af9d635c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.647563 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-a595608e-0b89-4fcb-9498-2de7522267e2 req-b34845a3-7904-4b18-aaff-d478af9d635c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.659911 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-a595608e-0b89-4fcb-9498-2de7522267e2 req-b34845a3-7904-4b18-aaff-d478af9d635c service nova] Creating event network-vif-deleted:45d8d52e-460d-4431-b7c9-86df07a543ed for instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 on hv-cinder-79760 Jul 18 14:26:58.665122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-a595608e-0b89-4fcb-9498-2de7522267e2 req-b34845a3-7904-4b18-aaff-d478af9d635c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035857 Jul 18 14:26:58.665755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 477/966] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:58.690726 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:58.692159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:58.699880 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.700335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.701111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.701627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.762740 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:58.764017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:58.771088 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:58.771667 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.772117 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.772885 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.773318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.781102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c3ddad1f-0f3c-4b88-8915-6e7cae89b892 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1299 microversion: 2.1 time: 0.094548 Jul 18 14:26:58.782558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 490/967] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:58 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1299 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:58.812086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:58.812705 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:58.820627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.821088 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.822030 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.822469 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.824788 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-98ff7260-8f74-41d6-8999-2e36a98dcfd4 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067398 Jul 18 14:26:58.829749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 478/968] 10.222.0.71 () {58 vars in 1301 bytes} [Mon Jul 18 14:26:58 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 18 14:26:58.894143 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:58.894646 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:58.896408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:58.901495 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.901978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.902748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:58.903182 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:58.904618 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e68b1c2f-e753-4794-a71c-f56ac3688757 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1614 microversion: 2.1 time: 0.097131 Jul 18 14:26:58.905591 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 491/969] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:58 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1614 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:58.930489 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:26:59.011031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aed6a953-b91f-4320-bca7-a908e98b389f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 204 len: 0 microversion: 2.1 time: 0.121036 Jul 18 14:26:59.011618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 479/970] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:26:58 2022] DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 18 14:26:59.020508 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:59.021160 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:59.028263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.028714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.029698 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.030301 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.132843 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-5dec368b-477c-467e-ad30-da6a6925da1e req-288a38c6-d4c5-4536-bdbf-ed0b8fb57a5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9694e4df-0587-4cd9-8b22-0259d9c551cd", "name": "network-vif-deleted", "tag": "32825ae0-1959-4368-9a80-fd1e53f403ad"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:26:59.152052 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5dec368b-477c-467e-ad30-da6a6925da1e req-288a38c6-d4c5-4536-bdbf-ed0b8fb57a5e service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.152497 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-5dec368b-477c-467e-ad30-da6a6925da1e req-288a38c6-d4c5-4536-bdbf-ed0b8fb57a5e service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.164918 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-5dec368b-477c-467e-ad30-da6a6925da1e req-288a38c6-d4c5-4536-bdbf-ed0b8fb57a5e service nova] Creating event network-vif-deleted:32825ae0-1959-4368-9a80-fd1e53f403ad for instance 9694e4df-0587-4cd9-8b22-0259d9c551cd on hv-cinder-79760 Jul 18 14:26:59.171446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-5dec368b-477c-467e-ad30-da6a6925da1e req-288a38c6-d4c5-4536-bdbf-ed0b8fb57a5e service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042795 Jul 18 14:26:59.172057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 480/971] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:26:59.198455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:59.207470 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a2f07efc-a277-48f0-8f31-a3ff517b3623 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1672 microversion: 2.1 time: 0.190728 Jul 18 14:26:59.208051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 492/972] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:59 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1672 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:26:59.799897 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:59.800593 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:59.807181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.807786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.808542 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.809057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.851974 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.852645 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.853487 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lazy-loading 'fault' on Instance uuid 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:26:59.908026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b750b0c7df7f4cee94b5b4d578f601b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e1451a6c59a4ef0b0cfe3cc6b98c605', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:26:59.916274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-94bf3d4e-897a-4748-bed9-93f00c7b60fa tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 200 len: 1304 microversion: 2.1 time: 0.121073 Jul 18 14:26:59.916840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 481/973] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:59 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:26:59.925140 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:26:59.925835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:26:59.932617 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.933057 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:26:59.933879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:26:59.934340 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:00.001918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:00.009892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-80b63bf2-9772-4b8b-b2e9-146a581099a8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1614 microversion: 2.1 time: 0.091452 Jul 18 14:27:00.010479 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 493/974] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:26:59 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:00.224619 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:00.225240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:00.231598 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:00.232050 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:00.232856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:00.233293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:00.375466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:00.383393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e849a516-5c57-4d46-840b-49517f75ddbf tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1672 microversion: 2.1 time: 0.162744 Jul 18 14:27:00.383939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 482/975] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:00 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:00.933257 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:00.933874 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] [instance: 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:00.941116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:00.941562 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:00.942367 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:00.942800 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:00.958471 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] HTTP exception thrown: Instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 could not be found. Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Request method failure captured: Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 HTTP/1.1 Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1W2Q23G9pyROr8x0RuTvO6mQVQwpiPZ57avfgtCFqkLdfGqfDMBLAioS3vC3YcJr1T3PDG-UrS6cn7DP4W5VQ97Wgi1PM9-Yk4phhIO2dbig5Yfxi16Ndt9ZhA0jXWde3EC-nEYPKWGd1p5LYLEhQZHus0P1GQ9gGohkxlIT24fWuNQ Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 3e1451a6c59a4ef0b0cfe3cc6b98c605 Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-VolumesActionsTest-1259292203 Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:00.960148 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/3e1451a6c59a4ef0b0cfe3cc6b98c605"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3e1451a6c59a4ef0b0cfe3cc6b98c605"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/3e1451a6c59a4ef0b0cfe3cc6b98c605"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_3e1451a6c59a4ef0b0cfe3cc6b98c605", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-VolumesActionsTest-1259292203 Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 3e1451a6c59a4ef0b0cfe3cc6b98c605 Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-VolumesActionsTest-1259292203 Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-VolumesActionsTest-1259292203-project Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: b750b0c7df7f4cee94b5b4d578f601b0 Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-VolumesActionsTest-1259292203-project Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 could not be found. Jul 18 14:27:00.961822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '35c2b8f0-7c28-4278-88fe-ec2c392ce7c5'} Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 could not be found. Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:00.962677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 could not be found. Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 could not be found. Jul 18 14:27:00.963968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:00.965132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] Returning 404 to user: Instance 35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:00.965132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-88892339-c2d3-4d1f-bf68-8e7d78233625 tempest-VolumesActionsTest-1259292203 tempest-VolumesActionsTest-1259292203-project] 10.222.0.71 "GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5" status: 404 len: 111 microversion: 2.1 time: 0.032419 Jul 18 14:27:00.965132 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 494/976] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:00 2022] GET /compute/v2.1/servers/35c2b8f0-7c28-4278-88fe-ec2c392ce7c5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:01.027645 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:01.028340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:01.035856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.036277 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.037057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.037515 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.072313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.072882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.073349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lazy-loading 'fault' on Instance uuid 9694e4df-0587-4cd9-8b22-0259d9c551cd {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:27:01.118106 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0210f69010b4529822bcdac1bdf8b8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94c7507618b247c98e6bb541a48dbd31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:01.129578 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-21ce5143-736b-49a4-8ce9-84df203bcdc7 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 200 len: 1331 microversion: 2.1 time: 0.105495 Jul 18 14:27:01.130201 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 483/977] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:01 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:01.402921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:01.403522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:01.422815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.429243 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.430968 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:01.434711 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:01.647561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:01.661292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e7db56ca-43d0-4870-8df5-5c64a2adfb5d tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1672 microversion: 2.1 time: 0.262092 Jul 18 14:27:01.664387 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 495/978] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:01 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1672 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:02.147278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:02.147900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:02.155530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:02.155993 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:02.156780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:02.157218 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:02.172421 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd HTTP/1.1 Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:02.174183 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:02.175670 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '9694e4df-0587-4cd9-8b22-0259d9c551cd'} Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:02.176472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:02.177785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:02.178847 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:02.178847 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-99f9797d-926c-4de7-9afa-f595433a2131 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 404 len: 111 microversion: 2.1 time: 0.032396 Jul 18 14:27:02.178847 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 484/979] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:02 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:02.185058 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c5c4f55e-b7cf-4fee-b15b-7c35d27e386c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '.version_select at 0x7fb53a12e9d0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:02.210466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c5c4f55e-b7cf-4fee-b15b-7c35d27e386c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-962466814" status: 202 len: 0 microversion: 2.1 time: 0.029230 Jul 18 14:27:02.211217 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 496/980] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 18 14:27:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-962466814 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:27:02.301554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-e74e3474-9f19-4591-a1d3-a122e6b7c854 req-65e817a6-c5d9-4b3a-9e7d-84efc88825a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fdc2f28-6e4e-4620-9ff1-3e41b54dae05", "name": "network-vif-deleted", "tag": "5fb9cd92-9a41-4e68-91c0-0da02d9f33b8"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:02.312467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e74e3474-9f19-4591-a1d3-a122e6b7c854 req-65e817a6-c5d9-4b3a-9e7d-84efc88825a8 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:02.313121 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-e74e3474-9f19-4591-a1d3-a122e6b7c854 req-65e817a6-c5d9-4b3a-9e7d-84efc88825a8 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:02.325338 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-e74e3474-9f19-4591-a1d3-a122e6b7c854 req-65e817a6-c5d9-4b3a-9e7d-84efc88825a8 service nova] Creating event network-vif-deleted:5fb9cd92-9a41-4e68-91c0-0da02d9f33b8 for instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 on hv-cinder-79760 Jul 18 14:27:02.330809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-e74e3474-9f19-4591-a1d3-a122e6b7c854 req-65e817a6-c5d9-4b3a-9e7d-84efc88825a8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033030 Jul 18 14:27:02.331626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 485/981] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:02.683009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:02.683938 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:02.691986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:02.692432 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:02.693523 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:02.694005 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:02.776613 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:02.785510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-36fec2ac-de4b-4983-b99e-bd3192bde06e tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1604 microversion: 2.1 time: 0.108722 Jul 18 14:27:02.786138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 497/982] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:02 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1604 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:03.803541 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:03.804291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:03.811078 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:03.811530 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:03.812306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:03.812737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:03.880051 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:03.892265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aafe97d5-3901-4a60-91fa-b05014a1b1d5 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1321 microversion: 2.1 time: 0.093338 Jul 18 14:27:03.892764 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 486/983] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:03 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1321 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:04.909117 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:04.910402 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:04.913694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:04.922673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:04.923128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:04.923916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:04.924416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:04.995433 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:05.003575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f8cc63bb-7630-4add-bfa4-e855b38fda2a tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1321 microversion: 2.1 time: 0.098455 Jul 18 14:27:05.004154 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 498/984] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:04 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1321 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:05.085445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:05.086900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:05.090736 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:05.098772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:05.099378 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:05.100588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:05.101303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:05.132158 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8cc9fa05-d8e9-42d8-8172-8e0b75d970c6 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053417 Jul 18 14:27:05.132715 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 487/985] 10.222.0.71 () {60 vars in 1342 bytes} [Mon Jul 18 14:27:05 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:05.205262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:05.205870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:05.212541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:05.213018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:05.213846 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:05.214293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:05.240858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:27:05.266937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:05.329764 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-478b7d79-33ad-4cb8-956d-d95eb70c2abb tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 204 len: 0 microversion: 2.20 time: 0.128138 Jul 18 14:27:05.330696 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 499/986] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 18 14:27:05 2022] DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:27:05.339231 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:05.339986 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:05.346755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:05.347209 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:05.348299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:05.348734 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:05.499314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:05.507929 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:05.509558 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:05.510961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b989302d-e076-4e71-a461-9e1cedbf40d0 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.175644 Jul 18 14:27:05.511612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 488/987] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:27:05 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 18 14:27:06.022621 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:06.023322 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:06.030560 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.031261 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.032057 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.032498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.069113 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.069554 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.070034 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lazy-loading 'fault' on Instance uuid 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:27:06.114622 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ca8be8093b547ee953ea646f90fdcae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1166ac77e8e403aa5f81e452bc039ac', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:06.129182 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7aec2305-7e56-4e9c-a138-70e22f992f7f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 200 len: 1326 microversion: 2.1 time: 0.110802 Jul 18 14:27:06.129812 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 500/988] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:06 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:27:06.267825 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:06.268466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:06.275534 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.276075 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.276863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.277317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.291901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd HTTP/1.1 Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:06.293606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.294969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '9694e4df-0587-4cd9-8b22-0259d9c551cd'} Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:06.296284 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.297511 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.298951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:06.298951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-3487250b-55c2-4c13-b55b-25c3600951ef tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 404 len: 111 microversion: 2.1 time: 0.031471 Jul 18 14:27:06.298951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 489/989] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:06 2022] DELETE /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:06.304684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:06.305180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9694e4df-0587-4cd9-8b22-0259d9c551cd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:06.312653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.313106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.313959 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.314399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.329853 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd HTTP/1.1 Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:06.331524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.333020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '9694e4df-0587-4cd9-8b22-0259d9c551cd'} Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:06.333941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. Jul 18 14:27:06.335480 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:06.337575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 9694e4df-0587-4cd9-8b22-0259d9c551cd could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:06.338461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8d7cf1bd-31df-40e8-95f8-1f707f6e69bc tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd" status: 404 len: 111 microversion: 2.1 time: 0.038061 Jul 18 14:27:06.339066 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 501/990] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:06 2022] GET /compute/v2.1/servers/9694e4df-0587-4cd9-8b22-0259d9c551cd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:06.531026 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:06.531651 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:06.544308 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.545517 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.548934 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:06.549759 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:06.556845 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:06.777239 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:06.796585 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:06.800157 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:06.802539 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-a009832b-3329-4d9c-867f-b004b94826de tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1724 microversion: 2.20 time: 0.275818 Jul 18 14:27:06.813696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 490/991] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:27:06 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:27:07.151831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.154172 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:07.164117 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.164672 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.165550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.166073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.187076 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] HTTP exception thrown: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Request method failure captured: Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 HTTP/1.1 Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvrnVaM4aqfzPiJD4kK4tLy7Mwr8qSOVkYD3tg26FLXb6tw28Ho14cMGOM5avv-d7l6FwEWD6Y9fN25uSz3Ye4oDTbkG3e5XmH3PT3ntotUO0Pj0J5FZeuUktRgjQ2BrKbuq_2rD1Q2-f4REjM9kJuNc5ZGXHvDJY8ShBJOFyVzyvs Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:07.190718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1166ac77e8e403aa5f81e452bc039ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 5ca8be8093b547ee953ea646f90fdcae Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:07.193614 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '7fdc2f28-6e4e-4620-9ff1-3e41b54dae05'} Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:07.195170 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:07.197886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.201714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Returning 404 to user: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:07.203022 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-c2e82665-b2b3-4fc1-9668-a059733aeb88 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 404 len: 111 microversion: 2.1 time: 0.058322 Jul 18 14:27:07.208700 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 502/992] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:07 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:07.215393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-af8a0c62-4539-40cd-9ed2-16ab6b842d4f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '.version_select at 0x7fb53a17f5e0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.244542 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-af8a0c62-4539-40cd-9ed2-16ab6b842d4f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-787372105" status: 202 len: 0 microversion: 2.1 time: 0.034925 Jul 18 14:27:07.254772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 491/993] 10.222.0.71 () {58 vars in 1217 bytes} [Mon Jul 18 14:27:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-787372105 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:27:07.551366 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.552089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:07.568104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.568635 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.576688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.577190 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.619386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf HTTP/1.1 Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:07.622399 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.625139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf'} Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:07.626642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.630292 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.636774 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:07.638646 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0cd812f7-1ed0-4e77-a9cd-a4e4354d2272 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 404 len: 111 microversion: 2.1 time: 0.095761 Jul 18 14:27:07.647077 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 503/994] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:07 2022] DELETE /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:07.651105 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.651812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:07.662963 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.663429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.664255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.664700 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.701364 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf HTTP/1.1 Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:07.705391 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.708145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf'} Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:07.709190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. Jul 18 14:27:07.713592 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.719629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:07.721764 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-11079904-2c74-431c-b6d5-a0d8db85eb5c tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf" status: 404 len: 111 microversion: 2.1 time: 0.074661 Jul 18 14:27:07.738060 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.738996 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 492/995] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:07 2022] GET /compute/v2.1/servers/2c8ebeb9-db8f-4cd2-9bc4-d2aed4065abf => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:07.740192 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:07.756218 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.762484 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.763971 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.764698 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.800333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 HTTP/1.1 Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:07.802478 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.810773 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2'} Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:07.812288 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.815986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.822825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:07.822825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bcc470fd-d3b3-4c16-9cf6-e9d7474fc5c8 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 404 len: 111 microversion: 2.1 time: 0.073955 Jul 18 14:27:07.822825 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 504/996] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:07 2022] DELETE /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:07.830260 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.830856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:07.831037 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:07.832576 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:07.844308 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.846056 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.848946 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.850681 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.852578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.853174 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.854440 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:07.854887 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:07.903733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 HTTP/1.1 Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:07.911353 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.914145 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2'} Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:07.915806 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. Jul 18 14:27:07.919292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:07.931177 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance 9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:07.931177 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f76f7c27-b731-4483-9854-dd6a189caa84 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2" status: 404 len: 111 microversion: 2.1 time: 0.104022 Jul 18 14:27:07.945621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 493/997] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:07 2022] GET /compute/v2.1/servers/9b7ab5fa-0d21-44f9-862d-5ac71f9f1fb2 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:08.017505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:08.027887 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:08.035786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3aab24bab8d74b7aa5a20e7b2b89b5d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6a24dfb85b04adfa565f06fde95d6b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:08.037468 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-96a1a7b2-f9b6-4806-bedc-8d542a81a50a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 200 len: 1656 microversion: 2.20 time: 0.216660 Jul 18 14:27:08.038323 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 505/998] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:27:07 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 1656 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 18 14:27:08.541751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-49a67180-7262-4f6d-83b2-a1b7100374f7 req-eb9bad2e-f121-4cad-9a9d-558304c59933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37e4e803-75d9-4b7d-8dfa-98d465a1e76b", "name": "network-vif-deleted", "tag": "ecacf148-6e72-4653-b111-eaa9fa31984d"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:08.560384 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-49a67180-7262-4f6d-83b2-a1b7100374f7 req-eb9bad2e-f121-4cad-9a9d-558304c59933 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:08.560824 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-49a67180-7262-4f6d-83b2-a1b7100374f7 req-eb9bad2e-f121-4cad-9a9d-558304c59933 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:08.588394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-49a67180-7262-4f6d-83b2-a1b7100374f7 req-eb9bad2e-f121-4cad-9a9d-558304c59933 service nova] Creating event network-vif-deleted:ecacf148-6e72-4653-b111-eaa9fa31984d for instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b on hv-cinder-79760 Jul 18 14:27:08.601812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-49a67180-7262-4f6d-83b2-a1b7100374f7 req-eb9bad2e-f121-4cad-9a9d-558304c59933 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066748 Jul 18 14:27:08.607797 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 494/999] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:09.061897 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:09.062576 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:09.078086 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:09.080861 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:09.081854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:09.084667 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:09.111486 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] HTTP exception thrown: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Request method failure captured: Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b HTTP/1.1 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvlwkoBn5cIKJEh9xfxHbGCTik4qtRUcyvu5k_QVwGr2rWhifEpow0CJ1F5yyPJxzGkeWfX4Atl5OI2USrnK_RNCTuc7NIjd1Rv7iXPKvS7W4m3fhKeCQIULVDQf7aQYYDASxZs4cL9lUSq-PsdO2BH97sFl5RvAo7jlVvsgvlGZd8 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:09.113492 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e6a24dfb85b04adfa565f06fde95d6b6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 3aab24bab8d74b7aa5a20e7b2b89b5d7 Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:09.115143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '37e4e803-75d9-4b7d-8dfa-98d465a1e76b'} Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:09.115911 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:09.117145 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.119815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Returning 404 to user: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:09.120948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2988bdd6-4e6a-4690-b77e-f6f8a3c36f0e tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 404 len: 111 microversion: 2.20 time: 0.063387 Jul 18 14:27:09.122059 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 506/1000] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:27:09 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:27:09.131979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ce4ad319-e95e-4a66-a5dd-ee1223c7dc78 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '.version_select at 0x7fb53a17f8b0>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:09.156418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ce4ad319-e95e-4a66-a5dd-ee1223c7dc78 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120188041" status: 204 len: 0 microversion: 2.20 time: 0.028885 Jul 18 14:27:09.158084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 495/1001] 10.222.0.71 () {60 vars in 1261 bytes} [Mon Jul 18 14:27:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120188041 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 18 14:27:09.216006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:09.216850 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:09.227973 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:09.229966 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:09.230963 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:09.235268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:09.269166 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c HTTP/1.1 Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:09.273958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.275406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'da73439b-b34f-42fb-b28a-9fa41604ab3c'} Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:09.276171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.277386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.280302 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:09.280302 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e0a63006-75c5-406d-986b-f3c7efb82acd tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 404 len: 111 microversion: 2.1 time: 0.064254 Jul 18 14:27:09.285577 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:09.286514 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] [instance: da73439b-b34f-42fb-b28a-9fa41604ab3c] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:09.293574 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:09.298211 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:09.298636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 507/1002] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:09 2022] DELETE /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:09.299773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:09.300804 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:09.320701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] HTTP exception thrown: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Request method failure captured: Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c HTTP/1.1 Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1Wvp-jP4IJ0HeuTvYNxJAituWf-uFl1LU15PyNAD3n61dt37_omIMyYM5Ei9B4mcjxy-wRHfo5po9SwNWtxoKnhJzv4F8rws0VFiFRkfvnajD_NrxabH08WC8iq5pF-wT9vO4ZDUUGReqdMtwaGeuBMwHFALbghbTKKv8UwLETnD2xQ Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:09.322991 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/94c7507618b247c98e6bb541a48dbd31"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_94c7507618b247c98e6bb541a48dbd31", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 94c7507618b247c98e6bb541a48dbd31 Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1847071225 Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: a0210f69010b4529822bcdac1bdf8b8a Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeNegativeTest-1847071225-project Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.324306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'da73439b-b34f-42fb-b28a-9fa41604ab3c'} Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:09.325081 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. Jul 18 14:27:09.326464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:09.328983 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] Returning 404 to user: Instance da73439b-b34f-42fb-b28a-9fa41604ab3c could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:09.331091 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1efa9b33-c3b3-4af1-8330-7b013443ea63 tempest-AttachVolumeNegativeTest-1847071225 tempest-AttachVolumeNegativeTest-1847071225-project] 10.222.0.71 "GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c" status: 404 len: 111 microversion: 2.1 time: 0.050232 Jul 18 14:27:09.341629 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 496/1003] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:09 2022] GET /compute/v2.1/servers/da73439b-b34f-42fb-b28a-9fa41604ab3c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 18 14:27:11.373332 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:11.377604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:11.385464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:11.386431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:11.388018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:11.388664 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:11.412104 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] HTTP exception thrown: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Request method failure captured: Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 HTTP/1.1 Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvrnVaM4aqfzPiJD4kK4tLy7Mwr8qSOVkYD3tg26FLXb6tw28Ho14cMGOM5avv-d7l6FwEWD6Y9fN25uSz3Ye4oDTbkG3e5XmH3PT3ntotUO0Pj0J5FZeuUktRgjQ2BrKbuq_2rD1Q2-f4REjM9kJuNc5ZGXHvDJY8ShBJOFyVzyvs Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:11.419383 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1166ac77e8e403aa5f81e452bc039ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 5ca8be8093b547ee953ea646f90fdcae Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.421673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '7fdc2f28-6e4e-4620-9ff1-3e41b54dae05'} Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:11.422455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.423835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.425296 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Returning 404 to user: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:11.427816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6b07f635-1a84-4162-8938-4652cefa305f tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 404 len: 111 microversion: 2.1 time: 0.069554 Jul 18 14:27:11.428707 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 508/1004] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:11 2022] DELETE /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:11.438712 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:11.439341 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:11.449811 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:11.450606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:11.451826 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:11.452555 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:11.468968 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] HTTP exception thrown: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Request method failure captured: Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 HTTP/1.1 Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvrnVaM4aqfzPiJD4kK4tLy7Mwr8qSOVkYD3tg26FLXb6tw28Ho14cMGOM5avv-d7l6FwEWD6Y9fN25uSz3Ye4oDTbkG3e5XmH3PT3ntotUO0Pj0J5FZeuUktRgjQ2BrKbuq_2rD1Q2-f4REjM9kJuNc5ZGXHvDJY8ShBJOFyVzyvs Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:11.470706 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1166ac77e8e403aa5f81e452bc039ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 5ca8be8093b547ee953ea646f90fdcae Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.472336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '7fdc2f28-6e4e-4620-9ff1-3e41b54dae05'} Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:11.473317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. Jul 18 14:27:11.474878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:11.478224 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Returning 404 to user: Instance 7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:11.479426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-47a06bd1-bda0-47df-9065-463b44d87312 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05" status: 404 len: 111 microversion: 2.1 time: 0.045123 Jul 18 14:27:11.480345 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 497/1005] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:11 2022] GET /compute/v2.1/servers/7fdc2f28-6e4e-4620-9ff1-3e41b54dae05 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:12.160824 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:12.161591 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:12.179805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.181369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.182520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.183128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.202461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] HTTP exception thrown: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Request method failure captured: Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b HTTP/1.1 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvlwkoBn5cIKJEh9xfxHbGCTik4qtRUcyvu5k_QVwGr2rWhifEpow0CJ1F5yyPJxzGkeWfX4Atl5OI2USrnK_RNCTuc7NIjd1Rv7iXPKvS7W4m3fhKeCQIULVDQf7aQYYDASxZs4cL9lUSq-PsdO2BH97sFl5RvAo7jlVvsgvlGZd8 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:12.204312 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e6a24dfb85b04adfa565f06fde95d6b6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 3aab24bab8d74b7aa5a20e7b2b89b5d7 Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.205744 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '37e4e803-75d9-4b7d-8dfa-98d465a1e76b'} Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:12.206488 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.207756 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.209018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Returning 404 to user: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:12.209018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f5d881a5-f19d-485d-b094-1249efc06042 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 404 len: 111 microversion: 2.20 time: 0.058444 Jul 18 14:27:12.212660 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 509/1006] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 18 14:27:12 2022] DELETE /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:27:12.217535 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:12.218668 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: 37e4e803-75d9-4b7d-8dfa-98d465a1e76b] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:12.226524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.227347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.228135 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.228570 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.246001 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] HTTP exception thrown: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Request method failure captured: Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b HTTP/1.1 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvlwkoBn5cIKJEh9xfxHbGCTik4qtRUcyvu5k_QVwGr2rWhifEpow0CJ1F5yyPJxzGkeWfX4Atl5OI2USrnK_RNCTuc7NIjd1Rv7iXPKvS7W4m3fhKeCQIULVDQf7aQYYDASxZs4cL9lUSq-PsdO2BH97sFl5RvAo7jlVvsgvlGZd8 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:12.247613 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e6a24dfb85b04adfa565f06fde95d6b6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 3aab24bab8d74b7aa5a20e7b2b89b5d7 Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.249118 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '37e4e803-75d9-4b7d-8dfa-98d465a1e76b'} Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:12.249954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. Jul 18 14:27:12.251763 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.252876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Returning 404 to user: Instance 37e4e803-75d9-4b7d-8dfa-98d465a1e76b could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:12.252876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-aa6e1c0e-5bc6-4ebf-8d1f-8dd4189ab83a tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b" status: 404 len: 111 microversion: 2.20 time: 0.036321 Jul 18 14:27:12.253501 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 498/1007] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:27:12 2022] GET /compute/v2.1/servers/37e4e803-75d9-4b7d-8dfa-98d465a1e76b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:27:12.756813 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:12.757372 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:12.769798 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.772734 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.774821 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.775600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.798948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] HTTP exception thrown: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Request method failure captured: Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb HTTP/1.1 Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvrnVaM4aqfzPiJD4kK4tLy7Mwr8qSOVkYD3tg26FLXb6tw28Ho14cMGOM5avv-d7l6FwEWD6Y9fN25uSz3Ye4oDTbkG3e5XmH3PT3ntotUO0Pj0J5FZeuUktRgjQ2BrKbuq_2rD1Q2-f4REjM9kJuNc5ZGXHvDJY8ShBJOFyVzyvs Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:12.801722 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1166ac77e8e403aa5f81e452bc039ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 5ca8be8093b547ee953ea646f90fdcae Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.803409 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '3954bb52-b979-4fd0-84c0-c95c060085eb'} Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:12.804388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.805923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.810080 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Returning 404 to user: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:12.811158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-88f8e460-4584-4194-a8fa-4a65bc02fdf2 tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 404 len: 111 microversion: 2.1 time: 0.060251 Jul 18 14:27:12.811916 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 510/1008] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:27:12 2022] DELETE /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:12.822588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:12.824208 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] [instance: 3954bb52-b979-4fd0-84c0-c95c060085eb] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:12.834303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.835005 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.835992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:12.837802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:12.856814 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] HTTP exception thrown: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Request method failure captured: Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb HTTP/1.1 Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvrnVaM4aqfzPiJD4kK4tLy7Mwr8qSOVkYD3tg26FLXb6tw28Ho14cMGOM5avv-d7l6FwEWD6Y9fN25uSz3Ye4oDTbkG3e5XmH3PT3ntotUO0Pj0J5FZeuUktRgjQ2BrKbuq_2rD1Q2-f4REjM9kJuNc5ZGXHvDJY8ShBJOFyVzyvs Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:12.859035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e1166ac77e8e403aa5f81e452bc039ac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e1166ac77e8e403aa5f81e452bc039ac", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: e1166ac77e8e403aa5f81e452bc039ac Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1468329912 Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 5ca8be8093b547ee953ea646f90fdcae Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeTestJSON-1468329912-project Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.860725 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '3954bb52-b979-4fd0-84c0-c95c060085eb'} Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:12.861687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. Jul 18 14:27:12.863191 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:12.865886 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] Returning 404 to user: Instance 3954bb52-b979-4fd0-84c0-c95c060085eb could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:12.866937 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-372c595e-ec56-45a0-abb7-d2c7f47257ff tempest-AttachVolumeTestJSON-1468329912 tempest-AttachVolumeTestJSON-1468329912-project] 10.222.0.71 "GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb" status: 404 len: 111 microversion: 2.1 time: 0.050561 Jul 18 14:27:12.868033 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 499/1009] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:12 2022] GET /compute/v2.1/servers/3954bb52-b979-4fd0-84c0-c95c060085eb => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:27:13.492125 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:13.492524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:13.503894 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:13.504352 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:13.505158 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:13.505593 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:13.525465 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] HTTP exception thrown: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Request method failure captured: Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 HTTP/1.1 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1WvlwkoBn5cIKJEh9xfxHbGCTik4qtRUcyvu5k_QVwGr2rWhifEpow0CJ1F5yyPJxzGkeWfX4Atl5OI2USrnK_RNCTuc7NIjd1Rv7iXPKvS7W4m3fhKeCQIULVDQf7aQYYDASxZs4cL9lUSq-PsdO2BH97sFl5RvAo7jlVvsgvlGZd8 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:27:13.527404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e6a24dfb85b04adfa565f06fde95d6b6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 3aab24bab8d74b7aa5a20e7b2b89b5d7 Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.529184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6'} Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:13.530111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.531353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.534286 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Returning 404 to user: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:13.535358 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a69e3c49-c16d-4ff4-8dfa-75b4ebb9b3b5 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 404 len: 111 microversion: 2.20 time: 0.047748 Jul 18 14:27:13.536482 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 511/1010] 10.222.0.71 () {60 vars in 1279 bytes} [Mon Jul 18 14:27:13 2022] DELETE /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:27:13.546802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:13.547432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] [instance: c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:13.555540 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:13.556000 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:13.556792 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:13.557238 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:13.573692 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] HTTP exception thrown: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Request method failure captured: Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 HTTP/1.1 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1WvlwkoBn5cIKJEh9xfxHbGCTik4qtRUcyvu5k_QVwGr2rWhifEpow0CJ1F5yyPJxzGkeWfX4Atl5OI2USrnK_RNCTuc7NIjd1Rv7iXPKvS7W4m3fhKeCQIULVDQf7aQYYDASxZs4cL9lUSq-PsdO2BH97sFl5RvAo7jlVvsgvlGZd8 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Openstack-Nova-Api-Version: 2.20 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:27:13.575316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/e6a24dfb85b04adfa565f06fde95d6b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_e6a24dfb85b04adfa565f06fde95d6b6", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: e6a24dfb85b04adfa565f06fde95d6b6 Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1185190314 Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 3aab24bab8d74b7aa5a20e7b2b89b5d7 Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1185190314-project Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.576772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6'} Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:27:13.577499 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. Jul 18 14:27:13.579230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:27:13.580306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] Returning 404 to user: Instance c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:27:13.580306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1396aed7-ae66-4e83-84dc-a46b901312d1 tempest-AttachVolumeShelveTestJSON-1185190314 tempest-AttachVolumeShelveTestJSON-1185190314-project] 10.222.0.71 "GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6" status: 404 len: 111 microversion: 2.20 time: 0.034617 Jul 18 14:27:13.581948 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 500/1011] 10.222.0.71 () {60 vars in 1276 bytes} [Mon Jul 18 14:27:13 2022] GET /compute/v2.1/servers/c0b674d9-38c6-4e8c-ac6d-cff5871dd2c6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 18 14:27:35.930740 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-315388979", "imageRef": "e0c82d3a-7037-4598-a012-859c87a5c53c", "flavorRef": "452"}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:35.937144 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:35.937823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:35.990937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] validate_networks() for None {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:27:36.273673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:27:36.274134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:27:36.274612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:27:36.275073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:27:36.275438 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:27:36.289505 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:36.289993 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:36.290846 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:36.291289 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:36.314495 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Getting quotas for project d944af7f74394542ac7b6cb64beb6070. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:27:36.320134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Getting quotas for user fc989f2fe18346fba53a08559e53d4b1 and project d944af7f74394542ac7b6cb64beb6070. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:27:36.332636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:27:36.335657 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e0c82d3a-7037-4598-a012-859c87a5c53c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:27:36.384209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fab2e770-ee6a-4c6e-9084-399f2f102703 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.457255 Jul 18 14:27:36.385150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 512/1012] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:27:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:27:36.395609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e5b9537c-b154-4c21-867a-c9f9a55f46ad tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:36.396252 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e5b9537c-b154-4c21-867a-c9f9a55f46ad tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:36.400051 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:36.400719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=20 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:36.466562 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e5b9537c-b154-4c21-867a-c9f9a55f46ad tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:36.474961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e5b9537c-b154-4c21-867a-c9f9a55f46ad tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1214 microversion: 2.1 time: 0.082943 Jul 18 14:27:36.475547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 501/1013] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:36 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:37.497293 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:37.498928 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:37.508865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:37.509452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:37.510339 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:37.510877 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:37.595095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:37.604189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8f74f55b-611c-4e21-8e28-1c346503c72b tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1266 microversion: 2.1 time: 0.112883 Jul 18 14:27:37.604732 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 513/1014] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:37 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1266 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:38.622842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:38.624088 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:38.632463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:38.632921 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:38.633691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:38.634313 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:38.706226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:38.716776 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bdafea35-a2d6-4c6e-9d3b-e318e32d250e tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1266 microversion: 2.1 time: 0.097993 Jul 18 14:27:38.717824 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 502/1015] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:38 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1266 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:39.734664 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:39.735283 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:39.743795 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:39.744282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:39.745150 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:39.746251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:39.823703 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:39.833143 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4aebfac4-3256-47af-9d6c-973af0105aff tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1266 microversion: 2.1 time: 0.103038 Jul 18 14:27:39.843575 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 514/1016] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:39 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:40.852856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:40.855130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:40.864580 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:40.865049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:40.865997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:40.866637 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:40.945483 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:40.953791 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b9a6a4c8-aa51-4852-8f4f-ab27ca6e6be1 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1272 microversion: 2.1 time: 0.106098 Jul 18 14:27:40.954372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 503/1017] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:40 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1272 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:41.972388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:41.973877 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:41.990245 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.993618 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:41.994841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:41.995466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:42.214522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:42.225276 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1450bc5f-6813-4010-8672-7de0ef438bcc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.257792 Jul 18 14:27:42.225901 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 515/1018] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:41 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:42.722625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-84058149-a64a-45c3-b355-1ed83f32c929 req-5dc25940-d4bd-49b9-834c-dd3908ad757d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e147d957-e73f-4d20-9c12-32e8f4193333", "tag": "e618dc2b-86fe-4fef-b5aa-8dfa0155f13f"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:42.763319 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-84058149-a64a-45c3-b355-1ed83f32c929 req-5dc25940-d4bd-49b9-834c-dd3908ad757d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:42.764072 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-84058149-a64a-45c3-b355-1ed83f32c929 req-5dc25940-d4bd-49b9-834c-dd3908ad757d service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:42.787750 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-84058149-a64a-45c3-b355-1ed83f32c929 req-5dc25940-d4bd-49b9-834c-dd3908ad757d service nova] Creating event network-changed:e618dc2b-86fe-4fef-b5aa-8dfa0155f13f for instance e147d957-e73f-4d20-9c12-32e8f4193333 on hv-cinder-79760 Jul 18 14:27:42.795479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-84058149-a64a-45c3-b355-1ed83f32c929 req-5dc25940-d4bd-49b9-834c-dd3908ad757d service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086839 Jul 18 14:27:42.797100 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 504/1019] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:43.243425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:43.244185 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:43.253107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:43.253873 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:43.254955 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:43.255570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:43.400823 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:43.408977 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-259342dd-e888-4431-aa71-9de620bf0867 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.170959 Jul 18 14:27:43.409556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 516/1020] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:43 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:44.427641 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:44.428454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:44.436207 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:44.436673 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:44.437438 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:44.437893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:44.580679 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:44.588781 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d5f6e676-921f-44dc-9156-ba87763b77be tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.166129 Jul 18 14:27:44.589447 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 505/1021] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:44 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:45.605792 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:45.606536 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:45.613388 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:45.613950 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:45.614878 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:45.615390 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:45.754891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:45.763307 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cefc2ec5-3133-44fa-8902-09faa1ca2861 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.160758 Jul 18 14:27:45.763865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 517/1022] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:45 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:46.780919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:46.781618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:46.785779 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:46.790569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:46.791093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:46.791960 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:46.792462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:46.927616 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:46.938967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d558d1a7-f449-47b3-9dba-9f5d00960e21 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.162606 Jul 18 14:27:46.939773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 506/1023] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:46 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:47.956350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:47.956967 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:47.958887 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:47.959550 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:27:47.967193 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:47.967649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:47.968438 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:47.968880 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:48.104489 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:48.113833 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1134bac8-29dc-4484-8a17-e0400c883794 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.161377 Jul 18 14:27:48.114466 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 518/1024] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:47 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:49.130045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:49.130664 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:49.138148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:49.138148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:49.138606 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:49.139035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:49.315642 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:49.323596 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-37b7f724-ed68-4d0b-a303-4fdbaa60525d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.197331 Jul 18 14:27:49.324175 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 507/1025] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:49 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:50.340282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:50.340906 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:50.348322 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:50.349177 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:50.350653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:50.351268 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:50.499198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:50.506948 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-eaea8c23-47a8-4b71-b137-c341058016ec tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.170481 Jul 18 14:27:50.507834 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 519/1026] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:50 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:51.526817 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:51.527544 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:51.538286 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:51.538984 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:51.540257 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:51.540878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:51.712268 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:51.720739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1bdd8c70-898b-4fe7-9da5-9130a3fa8dea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.197700 Jul 18 14:27:51.721684 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 508/1027] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:51 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:52.738461 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:52.739884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:52.748130 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:52.748896 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:52.749879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:52.750477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:52.912165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:52.921731 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-f79164e6-798e-4ab8-af41-7ef224f4568a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.187098 Jul 18 14:27:52.922918 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 520/1028] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:52 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:53.941445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:53.942092 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:53.948809 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.949426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:53.950564 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:53.951087 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:54.103710 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:54.113823 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5fd5cf9b-f56e-418e-8811-cb77b9ea1ab2 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.176975 Jul 18 14:27:54.127973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 509/1029] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:53 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:54.145924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-82f976b3-a625-488c-b572-4d80a5a63edf req-2c7d58f2-4bda-4830-b0f6-0e45ce311899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e147d957-e73f-4d20-9c12-32e8f4193333", "name": "network-vif-plugged", "status": "completed", "tag": "e618dc2b-86fe-4fef-b5aa-8dfa0155f13f"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:27:54.156530 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-82f976b3-a625-488c-b572-4d80a5a63edf req-2c7d58f2-4bda-4830-b0f6-0e45ce311899 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:54.157376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-82f976b3-a625-488c-b572-4d80a5a63edf req-2c7d58f2-4bda-4830-b0f6-0e45ce311899 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:54.176066 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-82f976b3-a625-488c-b572-4d80a5a63edf req-2c7d58f2-4bda-4830-b0f6-0e45ce311899 service nova] Creating event network-vif-plugged:e618dc2b-86fe-4fef-b5aa-8dfa0155f13f for instance e147d957-e73f-4d20-9c12-32e8f4193333 on hv-cinder-79760 Jul 18 14:27:54.183641 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-82f976b3-a625-488c-b572-4d80a5a63edf req-2c7d58f2-4bda-4830-b0f6-0e45ce311899 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041392 Jul 18 14:27:54.185164 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 521/1030] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:27:55.136466 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:55.137339 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:55.144164 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:55.144639 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:55.145408 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:55.145884 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:55.286749 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:55.297460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4a32305c-cf57-4a5d-9bbf-82291fa3795a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.165309 Jul 18 14:27:55.298111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 510/1031] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:55 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:56.321299 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:56.321983 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:56.329211 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:56.329675 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:56.330439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:56.330869 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:56.475994 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:56.483408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-8a648321-1547-4be0-a722-729470d942ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.167400 Jul 18 14:27:56.483987 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 522/1032] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:56 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:57.501508 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:57.502193 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:57.509154 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:57.509611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:57.510409 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:57.510846 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:57.678548 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:57.686559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-abed1c6d-ba1c-4fd6-9e04-6fd9854247d0 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.189044 Jul 18 14:27:57.687128 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 511/1033] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:57 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:58.703660 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:58.704541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:58.711435 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:58.711876 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:58.712656 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:58.713073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:58.866370 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:27:58.875295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-67feb4c7-14da-4d25-a05e-ab103efec9dc tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1314 microversion: 2.1 time: 0.175499 Jul 18 14:27:58.875954 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 523/1034] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:58 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:27:59.900404 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:27:59.901446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:27:59.911727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:59.912288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:27:59.913297 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:27:59.914208 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:00.070536 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:00.080492 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4edc34d0-ed24-4184-acf8-75b47d687d4c tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1463 microversion: 2.1 time: 0.190541 Jul 18 14:28:00.081077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 512/1035] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:27:59 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1463 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:28:00.131741 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:00.132328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:00.140050 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:00.140295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:00.141251 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:00.141514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:00.169816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:28:00.256151 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a010eeac-1002-475a-9645-8944fbfd56ea tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "DELETE /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 204 len: 0 microversion: 2.1 time: 0.127695 Jul 18 14:28:00.256854 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 524/1036] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:28:00 2022] DELETE /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:28:00.266436 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:00.266988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:00.273612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:00.274325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:00.275201 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:00.275988 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:00.707895 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:00.716370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-292a834a-529b-40f0-9f38-c80a2abe331d tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1469 microversion: 2.1 time: 0.454871 Jul 18 14:28:00.716938 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 513/1037] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:00 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1469 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:01.735869 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:01.737286 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:01.744632 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:01.745085 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:01.746089 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:01.746839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:01.898344 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:01.913806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0fa19b5c-93b0-47b6-95f7-19244652008a tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1469 microversion: 2.1 time: 0.176342 Jul 18 14:28:01.913806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 525/1038] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:01 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1469 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:02.534773 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-6b07a072-b083-4149-8dc0-539b1fc1e77f req-01b1b6cc-4880-42d4-b196-814842c54e8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e147d957-e73f-4d20-9c12-32e8f4193333", "name": "network-vif-deleted", "tag": "e618dc2b-86fe-4fef-b5aa-8dfa0155f13f"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:02.551509 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-6b07a072-b083-4149-8dc0-539b1fc1e77f req-01b1b6cc-4880-42d4-b196-814842c54e8f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:02.552828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-6b07a072-b083-4149-8dc0-539b1fc1e77f req-01b1b6cc-4880-42d4-b196-814842c54e8f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:02.567460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-6b07a072-b083-4149-8dc0-539b1fc1e77f req-01b1b6cc-4880-42d4-b196-814842c54e8f service nova] Creating event network-vif-deleted:e618dc2b-86fe-4fef-b5aa-8dfa0155f13f for instance e147d957-e73f-4d20-9c12-32e8f4193333 on hv-cinder-79760 Jul 18 14:28:02.572898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-6b07a072-b083-4149-8dc0-539b1fc1e77f req-01b1b6cc-4880-42d4-b196-814842c54e8f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042179 Jul 18 14:28:02.573813 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 514/1039] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:02.924206 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:02.926565 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:02.945789 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:02.946865 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:02.948473 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:02.949908 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:02.990180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:02.990765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:02.991333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.objects.instance [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lazy-loading 'fault' on Instance uuid e147d957-e73f-4d20-9c12-32e8f4193333 {{(pid=117767) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:28:03.039425 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc989f2fe18346fba53a08559e53d4b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd944af7f74394542ac7b6cb64beb6070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:03.049517 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-42bcdacb-e6a1-41b8-a6df-4314195a77a4 tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 200 len: 1304 microversion: 2.1 time: 0.129314 Jul 18 14:28:03.050139 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 526/1040] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:02 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:04.068609 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:04.069275 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] [instance: e147d957-e73f-4d20-9c12-32e8f4193333] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:04.076992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:04.077531 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:04.078276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:04.078736 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:04.094181 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] HTTP exception thrown: Instance e147d957-e73f-4d20-9c12-32e8f4193333 could not be found. Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Request method failure captured: Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 HTTP/1.1 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1W3Wd_tmnTkFDdOXTqWBx8teZqnaDY6PEfifSIUdylo-GFxmR0DHKDs48HY2h89VoQWxlzb9MZbKj5xb387TbLdXO0MVWk18t5LpTpTnCdH-6mLI0aOrpnPGOE7oFvtch4iIPGmLGoSACfK9Ee8b0Lx6TZVd14TlRn_0pMRSxu2eGj4 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: d944af7f74394542ac7b6cb64beb6070 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-VolumesNegativeTest-1752212141 Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:28:04.095875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/d944af7f74394542ac7b6cb64beb6070"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d944af7f74394542ac7b6cb64beb6070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/d944af7f74394542ac7b6cb64beb6070"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_d944af7f74394542ac7b6cb64beb6070", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-VolumesNegativeTest-1752212141 Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: d944af7f74394542ac7b6cb64beb6070 Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-VolumesNegativeTest-1752212141 Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-VolumesNegativeTest-1752212141-project Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: fc989f2fe18346fba53a08559e53d4b1 Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-VolumesNegativeTest-1752212141-project Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance e147d957-e73f-4d20-9c12-32e8f4193333 could not be found. Jul 18 14:28:04.097917 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': 'e147d957-e73f-4d20-9c12-32e8f4193333'} Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e147d957-e73f-4d20-9c12-32e8f4193333 could not be found. Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:28:04.099229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e147d957-e73f-4d20-9c12-32e8f4193333 could not be found. Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e147d957-e73f-4d20-9c12-32e8f4193333 could not be found. Jul 18 14:28:04.101423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:28:04.103300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] Returning 404 to user: Instance e147d957-e73f-4d20-9c12-32e8f4193333 could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:28:04.103300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-202a2ceb-80ba-41a9-9e7e-c179c358807f tempest-VolumesNegativeTest-1752212141 tempest-VolumesNegativeTest-1752212141-project] 10.222.0.71 "GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333" status: 404 len: 111 microversion: 2.1 time: 0.033727 Jul 18 14:28:04.103300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 515/1041] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:04 2022] GET /compute/v2.1/servers/e147d957-e73f-4d20-9c12-32e8f4193333 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:28:21.850746 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:21.851899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:22.144500 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b296fcc5-5d02-4f54-b6e3-fc4eb51ffddf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Action: 'create', calling method: .version_select at 0x7fb53eac55e0>, body: {"keypair": {"name": "tempest-TestShelveInstance-373848557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhm+a/BttsfkKYHw1ccalr/8CP/VhdJZCGLP86itCSlpaKnK7L2uSaPKH9tT5/5NckpBjYZpD+3foJgnZV9NFI070GxfA08H+PNQoY3kG4CBLhK6NW4cvsT1DTdhFr/cQ=="}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:22.160698 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-b296fcc5-5d02-4f54-b6e3-fc4eb51ffddf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Getting quotas for project bfe924f59fd34f58b443e1c324dc581c. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:28:22.165131 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-b296fcc5-5d02-4f54-b6e3-fc4eb51ffddf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Getting quotas for user 0b41303f85c7455087c8d25658f1a548 and project bfe924f59fd34f58b443e1c324dc581c. Resources: {'key_pairs'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:28:22.193937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b296fcc5-5d02-4f54-b6e3-fc4eb51ffddf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.348577 Jul 18 14:28:22.194661 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 527/1042] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:28:21 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:28:44.211662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=32 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:44.212464 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=72 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:44.466359 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e9966ba9-b37e-49ed-bbc6-374b1d6197c1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Action: 'create', calling method: .version_select at 0x7fb53a1bc820>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1235874317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxH78HyByq+lw2GnWu9XdrRVnBHHlhfUuXSLWNIJMzEEB1BUMnvN8PY2fbOXb8ROvvN7u0HNhGZ/LS5yDKwWVBBUGzyAHPAy8Di/0vzJazjENZC7DJvV/nS1LBmutKaHw=="}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:44.485560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-e9966ba9-b37e-49ed-bbc6-374b1d6197c1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for project 7a000079ba214fdf934764899139f62d. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:28:44.490144 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-e9966ba9-b37e-49ed-bbc6-374b1d6197c1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for user 7093c86da40243a5a8e50ad0f4cd33bb and project 7a000079ba214fdf934764899139f62d. Resources: {'key_pairs'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:28:44.518650 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e9966ba9-b37e-49ed-bbc6-374b1d6197c1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.313151 Jul 18 14:28:44.519255 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 516/1043] 10.222.0.71 () {60 vars in 1158 bytes} [Mon Jul 18 14:28:44 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:48.610115 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-776640265", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-373848557", "security_groups": [{"name": "tempest-secgroup-smoke-1331303935"}], "networks": [{"uuid": "3f064b14-74a3-4058-bbf8-5c32f9c2a8e5"}], "block_device_mapping_v2": [{"uuid": "adcf6a22-870b-484d-abf9-4fdbd9b97cf8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:48.620999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=4 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:48.622035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:28:48.771111 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] validate_networks() for [('3f064b14-74a3-4058-bbf8-5c32f9c2a8e5', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:28:49.291171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:28:49.291795 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:28:49.292539 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:28:49.292958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:28:49.293373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:28:49.303451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:49.303904 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:49.304935 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:49.305373 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:49.332922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Getting quotas for project bfe924f59fd34f58b443e1c324dc581c. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:28:49.341418 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Getting quotas for user 0b41303f85c7455087c8d25658f1a548 and project bfe924f59fd34f58b443e1c324dc581c. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:28:49.444819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:28:49.447397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='adcf6a22-870b-484d-abf9-4fdbd9b97cf8',volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:28:49.604558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3d2b4144-7d45-4379-bb98-c9fa4a13bcd1 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.998965 Jul 18 14:28:49.610832 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 528/1044] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:28:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:28:49.621778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-06a7a8b7-eae8-4003-bf21-3cbbdd46eca7 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:49.623099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-06a7a8b7-eae8-4003-bf21-3cbbdd46eca7 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:49.690842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-06a7a8b7-eae8-4003-bf21-3cbbdd46eca7 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:49.701196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-06a7a8b7-eae8-4003-bf21-3cbbdd46eca7 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1087 microversion: 2.1 time: 0.087846 Jul 18 14:28:49.702580 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 517/1045] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:49 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1087 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:50.720359 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:50.721846 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:50.730635 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:50.731446 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:50.733075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:50.733743 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:50.841815 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:50.863923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3fb322bf-bc56-4e5a-b3f1-d77545b68216 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1185 microversion: 2.1 time: 0.142048 Jul 18 14:28:50.866497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 529/1046] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:50 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1185 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:51.883909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:51.884668 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:51.893909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:51.895097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:51.895994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:51.896687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:52.081340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:52.091460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ca191eba-e1a5-4624-abcf-4bcee2699c1a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.211651 Jul 18 14:28:52.092155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 518/1047] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:51 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:52.491416 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-5d2b86dd-ab78-4cda-b5e0-2ce7dc42ba1c req-c6168ca4-320c-4262-ba01-dc6fec45f3f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:28:52.503658 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5d2b86dd-ab78-4cda-b5e0-2ce7dc42ba1c req-c6168ca4-320c-4262-ba01-dc6fec45f3f7 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:52.504408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-5d2b86dd-ab78-4cda-b5e0-2ce7dc42ba1c req-c6168ca4-320c-4262-ba01-dc6fec45f3f7 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:52.518890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-5d2b86dd-ab78-4cda-b5e0-2ce7dc42ba1c req-c6168ca4-320c-4262-ba01-dc6fec45f3f7 service nova] Creating event network-changed:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:28:52.524337 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-5d2b86dd-ab78-4cda-b5e0-2ce7dc42ba1c req-c6168ca4-320c-4262-ba01-dc6fec45f3f7 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044741 Jul 18 14:28:52.525345 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 530/1048] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:28:53.110016 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:53.110986 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:53.122848 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:53.123305 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:53.124080 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:53.124556 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:53.280478 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:53.288091 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9f1da70d-db94-498d-8825-33dcb4ecc3b3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.182717 Jul 18 14:28:53.288665 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 519/1049] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:53 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:54.304900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:54.305603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:54.314107 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:54.314578 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:54.315369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:54.315805 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:54.474680 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:54.482714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7cc44c90-0a93-4332-aa44-92b97c0fbcc0 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.181679 Jul 18 14:28:54.483327 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 531/1050] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:54 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:55.501334 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:55.501990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:55.508855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.509315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.510225 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:55.510724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:55.663430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:55.672694 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2bb18e4c-0430-4362-b009-b6dca3d03b0a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.176174 Jul 18 14:28:55.673204 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 520/1051] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:55 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:56.690029 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:56.690637 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:56.697557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:56.698039 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:56.698891 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:56.699234 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:56.847197 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:56.856232 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4315f4ff-78f8-41dc-9693-7812b0a7be19 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.170065 Jul 18 14:28:56.856822 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 532/1052] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:56 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:57.877163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:57.878485 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:57.890074 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:57.890524 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:57.891302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:57.891722 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:58.050195 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:58.058568 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8971cd57-0e6f-4a6c-81db-916acedd7e0c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.187896 Jul 18 14:28:58.059142 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 521/1053] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:57 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:28:59.078713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:28:59.079604 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:28:59.087922 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:59.088985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:59.089867 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:28:59.090306 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:28:59.239476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:28:59.251376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cdc4b1ec-2934-45ae-b717-f26a3a783395 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.178673 Jul 18 14:28:59.252282 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 533/1054] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:28:59 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:00.272069 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:00.272868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:00.274916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:00.281352 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:00.281724 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:00.282429 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:00.282855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:00.426306 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:00.436662 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-bb0434b0-f0ba-4aec-a1a2-adf473d7b1f3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.168313 Jul 18 14:29:00.437481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 522/1055] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:00 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:01.454580 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:01.455182 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:01.457295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:01.457991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:01.465080 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.465535 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.466392 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:01.466836 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:01.616890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:01.626717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ea838404-4607-4b67-afb6-7844e98fcb56 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.176568 Jul 18 14:29:01.627320 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 534/1056] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:01 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:02.660140 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:02.660868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:02.667812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:02.668274 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:02.669070 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:02.669579 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:03.003474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:03.011406 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d0cc5987-375f-4380-88ee-dfe832fe6496 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.355161 Jul 18 14:29:03.011970 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 523/1057] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:02 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:04.029835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:04.030502 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:04.038862 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:04.039336 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:04.040476 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:04.041041 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:04.184155 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:04.192364 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-6caa42f1-13a1-41ae-8fa8-4b048257bb7f tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.167049 Jul 18 14:29:04.192938 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 535/1058] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:04 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:04.614924 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-3364ac5f-b374-4369-b799-82a253f436de req-05f1256c-dd9a-4f66-9a2a-39cecbeb6956 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "name": "network-vif-plugged", "status": "completed", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:04.624883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-3364ac5f-b374-4369-b799-82a253f436de req-05f1256c-dd9a-4f66-9a2a-39cecbeb6956 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:04.625835 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-3364ac5f-b374-4369-b799-82a253f436de req-05f1256c-dd9a-4f66-9a2a-39cecbeb6956 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:04.639481 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-3364ac5f-b374-4369-b799-82a253f436de req-05f1256c-dd9a-4f66-9a2a-39cecbeb6956 service nova] Creating event network-vif-plugged:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:29:04.644997 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-3364ac5f-b374-4369-b799-82a253f436de req-05f1256c-dd9a-4f66-9a2a-39cecbeb6956 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034279 Jul 18 14:29:04.645992 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 524/1059] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:29:05.210662 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:05.211313 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:05.218097 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:05.218557 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:05.219318 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:05.219760 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:05.361633 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:05.372498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ad10f86a-c5de-4778-8abc-c4cc368aba06 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.165704 Jul 18 14:29:05.373079 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 536/1060] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:05 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:06.392455 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:06.393472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:06.403440 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:06.403891 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:06.404756 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:06.405196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:06.571893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:06.580233 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5685381c-21d8-4ac4-822b-e19a22f4300a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.194447 Jul 18 14:29:06.580810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 525/1061] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:06 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:07.597570 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:07.598239 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:07.605906 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:07.606360 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:07.607451 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:07.607947 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:07.816706 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:07.825746 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7019ba05-f7d9-4265-86ab-49537f10746a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.232125 Jul 18 14:29:07.826408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 537/1062] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:07 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:07.993057 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-712828040", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1235874317", "security_groups": [{"name": "tempest-secgroup-smoke-2084505188"}], "block_device_mapping_v2": [{"uuid": "f5c4486b-94d2-49bf-af15-369bb9ae7d96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987edc6b-a6e7-432a-b5f2-10915c51b659"}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:08.122569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] validate_networks() for [('987edc6b-a6e7-432a-b5f2-10915c51b659', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:29:08.521577 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:29:08.522036 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:29:08.522508 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:29:08.522919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:29:08.523325 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:29:08.533989 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:08.534441 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:08.535232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:08.535657 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:08.553252 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for project 7a000079ba214fdf934764899139f62d. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:29:08.557877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for user 7093c86da40243a5a8e50ad0f4cd33bb and project 7a000079ba214fdf934764899139f62d. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:29:08.623288 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:29:08.625363 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5c4486b-94d2-49bf-af15-369bb9ae7d96',volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:29:08.770837 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-33254699-af44-4b22-95ae-1220088a88f4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.783705 Jul 18 14:29:08.771479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 526/1063] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:29:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 785 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:29:08.782541 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-31c437d3-5f6c-4564-9a89-7a964a188b7a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:08.783157 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-31c437d3-5f6c-4564-9a89-7a964a188b7a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:08.839959 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-31c437d3-5f6c-4564-9a89-7a964a188b7a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:08.843487 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:08.843648 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:08.848035 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-31c437d3-5f6c-4564-9a89-7a964a188b7a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1094 microversion: 2.1 time: 0.069489 Jul 18 14:29:08.851552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 538/1064] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:08 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:08.851748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:08.851748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:08.851748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:08.851748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:08.997139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:09.005523 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-2bf66032-d76c-4cf3-8fc1-0a2d1788586b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.166315 Jul 18 14:29:09.006160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 527/1065] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:08 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:29:09.867766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:09.868346 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:09.878750 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:09.879277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:09.880197 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:09.880724 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:09.958726 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:09.970404 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4af3cf4d-ed10-4846-be53-88dc7aaac9c0 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1144 microversion: 2.1 time: 0.108094 Jul 18 14:29:09.971095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 539/1066] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:09 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1144 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:10.023108 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:10.023719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:10.030389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:10.030857 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:10.031621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:10.032098 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:10.176179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:10.184381 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-1f95be0a-d36e-49ab-ada7-522c675ca4ac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1259 microversion: 2.1 time: 0.165290 Jul 18 14:29:10.185044 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 528/1067] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:10 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:10.992716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:10.993267 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:11.001147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:11.001959 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:11.002787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:11.003331 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:11.084122 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:11.092069 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b4ceff50-83fe-4b80-be46-46b55c661cc4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1136 microversion: 2.1 time: 0.106289 Jul 18 14:29:11.092969 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 540/1068] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:10 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1136 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:11.203479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:11.204095 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:11.211001 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:11.211449 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:11.212212 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:11.212701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:11.351545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:11.361149 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9d3ca841-a9cf-4187-adad-792fa3cc084c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1444 microversion: 2.1 time: 0.161681 Jul 18 14:29:11.361721 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 529/1069] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:11 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:11.377596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:11.378221 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:11.384587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:11.385098 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:11.385943 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:11.386411 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:11.658228 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:11.670464 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-381c551f-769e-4e9c-b051-6bbab77a1af5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1444 microversion: 2.1 time: 0.296297 Jul 18 14:29:11.671316 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 541/1070] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:11 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1444 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:12.112330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:12.113235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:12.122719 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:12.123432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:12.125422 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:12.126231 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:12.301332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:12.313728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ff5540e5-2d34-4432-b2a8-ed6469c3756f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1210 microversion: 2.1 time: 0.208268 Jul 18 14:29:12.315875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 530/1071] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:12 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1210 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:13.338129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:13.338933 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:13.357809 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:13.360389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-dd29b1f6-d299-4dca-ae0b-8ad9b500d436 req-d1382298-d173-4d89-bb78-c73c834c2575 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a28d78c-fdaf-4772-bcbb-30e790b003da", "tag": "f31f373b-229f-439e-95b5-6ce204482eeb"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:13.362056 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:13.363507 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:13.364477 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:13.372286 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dd29b1f6-d299-4dca-ae0b-8ad9b500d436 req-d1382298-d173-4d89-bb78-c73c834c2575 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:13.372745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-dd29b1f6-d299-4dca-ae0b-8ad9b500d436 req-d1382298-d173-4d89-bb78-c73c834c2575 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:13.399681 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-dd29b1f6-d299-4dca-ae0b-8ad9b500d436 req-d1382298-d173-4d89-bb78-c73c834c2575 service nova] Creating event network-changed:f31f373b-229f-439e-95b5-6ce204482eeb for instance 6a28d78c-fdaf-4772-bcbb-30e790b003da on hv-cinder-79760 Jul 18 14:29:13.409645 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-dd29b1f6-d299-4dca-ae0b-8ad9b500d436 req-d1382298-d173-4d89-bb78-c73c834c2575 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059708 Jul 18 14:29:13.416129 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 531/1072] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jul 18 14:29:13.719116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:13.727560 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-32797956-2f2d-41d9-a003-3a1d3076d289 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.399417 Jul 18 14:29:13.727990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 542/1073] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:13 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:14.177049 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-8a038a7b-4b90-4241-b8ea-ac8a042188b1 req-81dbfcc0-5051-4c60-a124-2e6c4af5e746 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:14.189299 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-8a038a7b-4b90-4241-b8ea-ac8a042188b1 req-81dbfcc0-5051-4c60-a124-2e6c4af5e746 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:14.189920 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-8a038a7b-4b90-4241-b8ea-ac8a042188b1 req-81dbfcc0-5051-4c60-a124-2e6c4af5e746 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:14.201877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-8a038a7b-4b90-4241-b8ea-ac8a042188b1 req-81dbfcc0-5051-4c60-a124-2e6c4af5e746 service nova] Creating event network-changed:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:29:14.212178 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-8a038a7b-4b90-4241-b8ea-ac8a042188b1 req-81dbfcc0-5051-4c60-a124-2e6c4af5e746 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039357 Jul 18 14:29:14.212905 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 532/1074] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:29:14.748892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:14.758302 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:14.768842 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:14.769603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:14.770583 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:14.771182 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:14.995830 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:15.006725 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9caceb0d-6942-47e0-a920-8e49f727f11b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.263454 Jul 18 14:29:15.016855 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 543/1075] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:14 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:16.024569 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:16.025318 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:16.027372 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=4 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:16.033998 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:16.034459 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:16.035234 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:16.035675 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:16.038841 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=75 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:16.193377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:16.201913 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-599ff24d-158a-4fca-b185-2e49fc40e9fe tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.182048 Jul 18 14:29:16.202502 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 533/1076] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:16 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:17.219988 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:17.220599 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:17.227548 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:17.228007 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:17.228860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:17.229269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:17.440448 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:17.449129 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7377d96c-fc85-4d60-b64f-29e988237839 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.233029 Jul 18 14:29:17.449794 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 544/1077] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:17 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:18.466726 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:18.467382 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:18.474467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:18.474919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:18.475683 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:18.476109 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:18.541741 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:18.568138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:18.629872 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:18.638298 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ff6b65b2-f741-4634-8faf-376be93e26f3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.175680 Jul 18 14:29:18.638909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 534/1078] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:18 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:19.655717 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:19.656333 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:19.658735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:19.659390 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:19.665485 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:19.666375 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:19.667168 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:19.667603 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:19.671073 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=89 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:29:19.820999 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:19.829010 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-cd7a4db9-108c-411a-9e31-8ab71c39732d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.177164 Jul 18 14:29:19.829590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 545/1079] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:19 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:20.848754 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:20.849387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:20.859900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:20.860540 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:20.861730 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:20.862397 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:21.012875 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:21.020938 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4ce5ed04-db4a-4ba5-a890-4da7d38669ef tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.177771 Jul 18 14:29:21.021502 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 535/1080] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:20 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:22.042182 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:22.042761 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:22.049870 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:22.050318 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:22.051085 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:22.051528 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:22.209141 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:22.217975 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-72b2eb86-bd02-4ef6-80b3-d2b00186781e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.181864 Jul 18 14:29:22.218522 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 546/1081] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:22 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:23.236167 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:23.236768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:23.247553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:23.248228 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:23.249134 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:23.249699 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:23.399555 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:23.416387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ec203d8f-9eca-4371-a4e7-8f78f50ac301 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.184530 Jul 18 14:29:23.417009 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 536/1082] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:23 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:24.436319 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:24.436905 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:24.443569 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:24.444020 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:24.444792 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:24.445227 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:24.495504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-80b28412-f61a-4292-9358-35b40cf99221 req-301574a4-4249-4661-9fb2-c8fb83d22514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a28d78c-fdaf-4772-bcbb-30e790b003da", "name": "network-vif-plugged", "status": "completed", "tag": "f31f373b-229f-439e-95b5-6ce204482eeb"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:24.504994 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-80b28412-f61a-4292-9358-35b40cf99221 req-301574a4-4249-4661-9fb2-c8fb83d22514 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:24.505608 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-80b28412-f61a-4292-9358-35b40cf99221 req-301574a4-4249-4661-9fb2-c8fb83d22514 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:24.519764 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-80b28412-f61a-4292-9358-35b40cf99221 req-301574a4-4249-4661-9fb2-c8fb83d22514 service nova] Creating event network-vif-plugged:f31f373b-229f-439e-95b5-6ce204482eeb for instance 6a28d78c-fdaf-4772-bcbb-30e790b003da on hv-cinder-79760 Jul 18 14:29:24.525430 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-80b28412-f61a-4292-9358-35b40cf99221 req-301574a4-4249-4661-9fb2-c8fb83d22514 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033641 Jul 18 14:29:24.526804 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 537/1083] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:29:24.587990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:24.595819 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-066834b0-0441-4b0a-888d-78caf137efa4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.163439 Jul 18 14:29:24.596386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 547/1084] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:24 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:25.618010 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:25.618737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:25.625958 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:25.626417 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:25.627190 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:25.627625 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:25.776224 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:25.784307 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b76acc48-d31a-4b99-ade0-7776d6af54bf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1266 microversion: 2.1 time: 0.170638 Jul 18 14:29:25.784892 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 538/1085] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:25 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:26.800564 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:26.801165 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:26.808269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:26.808719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:26.809497 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:26.809976 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:26.949606 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:26.957400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7c741a3b-6dfa-4411-8809-b88b1daab2cf tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1454 microversion: 2.1 time: 0.160711 Jul 18 14:29:26.958006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 548/1086] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:26 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1454 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:26.973528 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:29:26.974116 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:29:26.981292 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:26.982055 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:26.982851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:26.983280 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:27.131272 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:29:27.139393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-9e9c101b-4dfb-47e6-803e-414a2f0db5dd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1454 microversion: 2.1 time: 0.169707 Jul 18 14:29:27.140254 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 539/1087] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:29:26 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1454 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:29:29.059363 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-bff2d168-1fd2-430c-9ee7-81f6cb7220dc req-a91d7558-a8bc-4493-8fac-4899dbf215f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a28d78c-fdaf-4772-bcbb-30e790b003da", "tag": "f31f373b-229f-439e-95b5-6ce204482eeb"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:29:29.068152 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-bff2d168-1fd2-430c-9ee7-81f6cb7220dc req-a91d7558-a8bc-4493-8fac-4899dbf215f6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:29:29.068677 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-bff2d168-1fd2-430c-9ee7-81f6cb7220dc req-a91d7558-a8bc-4493-8fac-4899dbf215f6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:29:29.080455 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-bff2d168-1fd2-430c-9ee7-81f6cb7220dc req-a91d7558-a8bc-4493-8fac-4899dbf215f6 service nova] Creating event network-changed:f31f373b-229f-439e-95b5-6ce204482eeb for instance 6a28d78c-fdaf-4772-bcbb-30e790b003da on hv-cinder-79760 Jul 18 14:29:29.085568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-bff2d168-1fd2-430c-9ee7-81f6cb7220dc req-a91d7558-a8bc-4493-8fac-4899dbf215f6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030029 Jul 18 14:29:29.086171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 549/1088] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:29:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:04.906986 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:31:04.907711 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:31:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:31:12.222454 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a5e0f617-7c39-4bd0-b98d-6ee647484ac3] AMQP server on 10.222.0.71:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 18 14:31:12.223461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=13 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:12.224474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=37 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:12.230087 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:12.230618 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:12.237728 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:12.238173 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:12.238927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:12.239374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:12.261961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lazy-loading 'flavor' on Instance uuid 149d386a-8674-4d14-9ff4-25427d71489e {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:31:12.358425 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5a7eeea4-c7c5-47e6-b770-8be332cf7e41 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "POST /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e/action" status: 202 len: 0 microversion: 2.1 time: 0.138557 Jul 18 14:31:12.359013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 540/1089] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:31:12 2022] POST /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 18 14:31:12.365680 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1f2b0a5d-fd29-4345-bde3-85c0b36447ce] AMQP server on 10.222.0.71:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 18 14:31:12.366252 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=9 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:12.366946 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=25 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:12.371670 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:12.372371 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:12.379716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:12.380147 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:12.380923 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:12.381362 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:12.532817 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:12.544457 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-47e78412-5e60-4596-9cd2-7cfdf833bbd5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.180347 Jul 18 14:31:12.545264 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 550/1090] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:12 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:13.572473 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:13.573176 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:13.582494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] [a5e0f617-7c39-4bd0-b98d-6ee647484ac3] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 41122. Jul 18 14:31:13.584265 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:13.584714 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:13.585554 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:13.586035 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:13.749555 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:13.757383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-78e91fc2-3e35-4e4a-8e84-b52625519ae3 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.193640 Jul 18 14:31:13.757979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 541/1091] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:13 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:14.779910 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:14.780532 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:14.787684 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:14.788119 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:14.788881 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:14.789305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:14.805352 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] [1f2b0a5d-fd29-4345-bde3-85c0b36447ce] Reconnected to AMQP server on 10.222.0.71:5672 via [amqp] client with port 41126. Jul 18 14:31:14.934370 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:14.942198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0a054848-8970-4156-bff1-8f955d5d228c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.166241 Jul 18 14:31:14.942797 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 551/1092] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:14 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:15.960465 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:15.961240 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:15.968655 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:15.969064 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:15.969868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:15.970302 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:16.121494 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:16.134462 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c749a291-7c88-486f-bc7b-629cf87db598 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.177191 Jul 18 14:31:16.135427 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 542/1093] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:15 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:17.156762 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:17.157353 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:17.164419 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:17.164874 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:17.165745 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:17.166125 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:17.309092 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:17.321051 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2239532f-3be3-47a0-ae92-571167408181 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.168047 Jul 18 14:31:17.322276 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 552/1094] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:17 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:18.339641 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:18.340276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:18.347345 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:18.347801 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:18.348572 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:18.349019 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:18.501822 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:18.509952 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-35039101-789b-461b-b61d-cccc2841645a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.174793 Jul 18 14:31:18.510588 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 543/1095] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:18 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:19.527807 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:19.528441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:19.535568 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:19.536021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:19.536806 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:19.537248 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:19.680601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:19.688649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2228cd89-d36b-421f-b106-a7220b182184 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.164816 Jul 18 14:31:19.689195 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 553/1096] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:19 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:20.707490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:20.708079 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:20.715526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:20.715978 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:20.716753 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:20.717189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:20.864470 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:20.872785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4d2beb36-c2c9-441a-a769-d1c3aab57d57 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.169215 Jul 18 14:31:20.873355 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 544/1097] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:20 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:21.890636 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:21.891207 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:21.898099 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:21.898545 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:21.899303 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:21.899828 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:22.054349 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:22.064945 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d35d5107-9c69-4032-97ea-f228988aec55 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.178018 Jul 18 14:31:22.065738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 554/1098] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:21 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:23.085230 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:23.085909 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:23.093410 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:23.093900 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:23.094692 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:23.095131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:23.324739 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:23.332577 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6016eb0b-1382-4e4b-a8b2-a14257db160d tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.253189 Jul 18 14:31:23.333139 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 545/1099] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:23 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:24.352253 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:24.353501 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:24.360601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:24.361059 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:24.361876 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:24.362317 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:24.511734 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:24.523219 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-414d1830-568d-4476-9e12-6f73b750c70c tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.176438 Jul 18 14:31:24.523980 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 555/1100] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:24 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:25.545045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:25.545686 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:25.552868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:25.553324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:25.554137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:25.555084 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:25.701347 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:25.709270 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-0e7c68d2-f7a8-47ed-afc7-4f9bc3884dd4 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.168515 Jul 18 14:31:25.710522 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 546/1101] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:25 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:26.438255 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:26.438863 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:26.445429 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.445919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.446900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.447223 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.476978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:31:26.561284 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-0bf2c46e-56af-4aae-9661-5ecc6c0393e5 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 204 len: 0 microversion: 2.1 time: 0.126784 Jul 18 14:31:26.562017 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 556/1102] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:31:26 2022] DELETE /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:31:26.570579 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:26.571184 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:26.577841 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.578291 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.579082 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.579496 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.728285 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:26.729042 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:26.730189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:26.735653 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.736095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.736889 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.737343 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.738393 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5c330a4d-555b-418e-93a9-c31a9cde1d55 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1579 microversion: 2.1 time: 0.171683 Jul 18 14:31:26.738968 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 547/1103] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:26 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1579 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:31:26.873054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:26.881408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-da89b076-b46b-4d98-a5d3-6a9108216c25 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1509 microversion: 2.1 time: 0.157923 Jul 18 14:31:26.882024 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 557/1104] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:26 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:26.900954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:26.901525 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:26.908073 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.908529 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:26.909300 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:26.909755 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:27.000723 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7abcb047-83c8-40e0-ab67-641a6fb0151a tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "POST /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e/action" status: 202 len: 0 microversion: 2.1 time: 0.103961 Jul 18 14:31:27.001324 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 548/1105] 10.222.0.71 () {60 vars in 1277 bytes} [Mon Jul 18 14:31:26 2022] POST /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:31:27.009924 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:27.010320 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:27.016519 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:27.017054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:27.017856 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:27.018294 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:27.187108 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:27.194834 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-54bebb5d-08f7-4cbf-83e7-b01f286f3b54 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1517 microversion: 2.1 time: 0.189307 Jul 18 14:31:27.195520 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 558/1106] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:27 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1517 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:27.760303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:27.761463 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:27.770868 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:27.771369 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:27.772192 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:27.772675 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:27.912912 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:27.920999 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-afb36c44-d9ad-4091-a50d-b72476d8ec23 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1579 microversion: 2.1 time: 0.167970 Jul 18 14:31:27.921573 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 549/1107] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:27 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:28.212961 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:28.213767 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:28.221371 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:28.221858 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:28.222643 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:28.223106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:28.463335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:28.472983 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a1b14c0a-b0e3-43fb-9f09-618b730a8dd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1519 microversion: 2.1 time: 0.264055 Jul 18 14:31:28.473962 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 559/1108] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:28 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1519 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:28.938915 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:28.940155 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:28.947518 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:28.947979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:28.948759 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:28.949202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:29.044532 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:29.061028 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-eff1920e-c09e-4d13-a67b-a9af750d47c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1511 microversion: 2.1 time: 0.124981 Jul 18 14:31:29.062990 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 550/1109] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:28 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1511 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:29.155718 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-b09e1737-c814-41e3-bd03-85d73758e9dd req-6b30a879-3d9c-458c-b766-020ffc7becc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "name": "network-vif-unplugged", "status": "completed", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:29.171407 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b09e1737-c814-41e3-bd03-85d73758e9dd req-6b30a879-3d9c-458c-b766-020ffc7becc2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:29.172859 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-b09e1737-c814-41e3-bd03-85d73758e9dd req-6b30a879-3d9c-458c-b766-020ffc7becc2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:29.201054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-b09e1737-c814-41e3-bd03-85d73758e9dd req-6b30a879-3d9c-458c-b766-020ffc7becc2 service nova] Creating event network-vif-unplugged:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:31:29.206649 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-b09e1737-c814-41e3-bd03-85d73758e9dd req-6b30a879-3d9c-458c-b766-020ffc7becc2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.123754 Jul 18 14:31:29.207456 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 560/1110] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:29.340069 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-600f7c2a-5931-4357-89a5-9a810e67ca5e req-eca3c932-19c2-41f4-8b26-3f7daaa1d638 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a28d78c-fdaf-4772-bcbb-30e790b003da", "name": "network-vif-deleted", "tag": "f31f373b-229f-439e-95b5-6ce204482eeb"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:29.350972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-600f7c2a-5931-4357-89a5-9a810e67ca5e req-eca3c932-19c2-41f4-8b26-3f7daaa1d638 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:29.351308 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-600f7c2a-5931-4357-89a5-9a810e67ca5e req-eca3c932-19c2-41f4-8b26-3f7daaa1d638 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:29.374160 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-600f7c2a-5931-4357-89a5-9a810e67ca5e req-eca3c932-19c2-41f4-8b26-3f7daaa1d638 service nova] Creating event network-vif-deleted:f31f373b-229f-439e-95b5-6ce204482eeb for instance 6a28d78c-fdaf-4772-bcbb-30e790b003da on hv-cinder-79760 Jul 18 14:31:29.384226 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-600f7c2a-5931-4357-89a5-9a810e67ca5e req-eca3c932-19c2-41f4-8b26-3f7daaa1d638 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124214 Jul 18 14:31:29.385973 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 551/1111] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:29.492262 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:29.494381 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:29.502127 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:29.502840 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:29.503860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:29.505021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:29.660331 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:29.668721 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-a35c9fc4-5130-4453-873d-663229b10f1b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.181251 Jul 18 14:31:29.669400 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 561/1112] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:29 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:30.081262 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:30.082076 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:30.088898 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:30.089448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:30.090354 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:30.090869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:30.130810 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:30.131276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:30.131747 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lazy-loading 'fault' on Instance uuid 6a28d78c-fdaf-4772-bcbb-30e790b003da {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:31:30.178672 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:30.187197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-ed5cf0ae-b07d-418b-ae15-54418c233d0e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 200 len: 1230 microversion: 2.1 time: 0.111615 Jul 18 14:31:30.187790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 552/1113] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:30 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 1230 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:30.687484 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:30.688091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:30.695254 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:30.695733 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:30.696552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:30.696990 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:30.840879 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:30.853019 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-1a076262-8061-4183-ae35-306bd55d7fac tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.169043 Jul 18 14:31:30.853589 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 562/1114] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:30 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:31.208565 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:31.209189 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:31.217045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:31.217472 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:31.218337 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:31.218777 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:31.232962 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] HTTP exception thrown: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Request method failure captured: Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da HTTP/1.1 Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1W4VyTYKx33l7YQU41bg9PNNcOKpVC3B2c31QVMv2X7KYVZvkQ2YVcNk6zjVSBkkIV0CmMM3WZk5-BnPRZMghX9ofF1XAw--x_JdJqng_w1NKXl1JrW9W779HQRy3ZJAJVbzYn2rkz1zD3yThGiig0-E_0grvaKMI5jlt5-mm9RAmUU Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:31:31.235017 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7a000079ba214fdf934764899139f62d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7a000079ba214fdf934764899139f62d", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-TestVolumeBootPattern-23737218 Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 7093c86da40243a5a8e50ad0f4cd33bb Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:31:31.236778 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '6a28d78c-fdaf-4772-bcbb-30e790b003da'} Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:31:31.237876 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:31:31.239545 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:31:31.241111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Returning 404 to user: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:31:31.241111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f0528673-4642-4538-b855-cc2767bd627d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 404 len: 111 microversion: 2.1 time: 0.033753 Jul 18 14:31:31.241111 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 553/1115] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:31 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:31:31.343083 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1025848456", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1235874317", "security_groups": [{"name": "tempest-secgroup-smoke-2084505188"}], "block_device_mapping_v2": [{"uuid": "f5c4486b-94d2-49bf-af15-369bb9ae7d96", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987edc6b-a6e7-432a-b5f2-10915c51b659"}]}} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:31.464481 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.network.neutron [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] validate_networks() for [('987edc6b-a6e7-432a-b5f2-10915c51b659', None, None, None, None, None)] {{(pid=117767) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:31:31.875295 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:31.875878 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:31.883223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:31.883682 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:31.884501 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:31.885137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:31.904340 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:31.965106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Flavor limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:31:31.965627 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Image limits 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:31:31.966142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Flavor pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:31:31.966546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Image pref 0:0:0 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:31:31.966992 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.virt.hardware [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117767) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:31:31.976561 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:31.977044 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:31.978659 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:31.979136 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:31.998545 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for project 7a000079ba214fdf934764899139f62d. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:31:32.002852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.quota [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for user 7093c86da40243a5a8e50ad0f4cd33bb and project 7a000079ba214fdf934764899139f62d. Resources: {'ram', 'cores', 'instances'} {{(pid=117767) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:31:32.038170 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:32.046460 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-6e508ac7-fb0b-4f0e-ab9d-a86de0953097 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.175101 Jul 18 14:31:32.047237 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 554/1116] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:31 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:31:32.063786 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Going to run 1 instances... {{(pid=117767) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:31:32.065921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f5c4486b-94d2-49bf-af15-369bb9ae7d96',volume_size=None,volume_type=None)] {{(pid=117767) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:31:32.204169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b9ff350c-9273-4fd5-9bf6-ac306549a51f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864999 Jul 18 14:31:32.204801 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 563/1117] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:31:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 866 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:31:32.215547 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-71c4e99d-0888-484c-bf7b-24f1079a129a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:32.216143 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-71c4e99d-0888-484c-bf7b-24f1079a129a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:32.270138 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-71c4e99d-0888-484c-bf7b-24f1079a129a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:32.278251 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-71c4e99d-0888-484c-bf7b-24f1079a129a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1095 microversion: 2.1 time: 0.066957 Jul 18 14:31:32.288413 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 555/1118] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:32 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:33.065237 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:33.065835 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:33.072647 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:33.073091 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:33.073886 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:33.074324 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:33.225766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:33.239799 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-3a5db4c8-304c-46b3-ab5b-faa0b5a545cf tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.178962 Jul 18 14:31:33.240384 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 564/1119] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:33 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:33.296485 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:33.297063 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:33.305394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:33.306316 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:33.307196 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:33.307631 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:33.377148 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:33.387612 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-74687c7c-58dc-475e-9b52-8609aa12d976 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1211 microversion: 2.1 time: 0.095353 Jul 18 14:31:33.388206 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 556/1120] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:33 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1211 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:34.258967 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:34.260084 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:34.268735 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.269235 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.270101 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.270524 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.408877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:34.410551 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:34.419894 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.420343 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.421314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.421940 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.443971 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:34.459106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-733bc479-4345-40b2-a35f-406ea8392f8e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.204298 Jul 18 14:31:34.459690 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 565/1121] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:34 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:34.592474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:34.602856 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-da3c12e2-fe8f-4bff-80c9-581be5a2d369 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.200452 Jul 18 14:31:34.603448 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 557/1122] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:34 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:34.826308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-6030be51-1111-45c4-b681-2423651851ee req-86c1a6ed-e5d1-48d3-9222-b9d017ee10d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cb30d8-74b9-41d3-be99-830cdb43c8dd", "tag": "7449e4d4-a7d1-4de2-8f16-14140f4f8f07"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:34.835095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6030be51-1111-45c4-b681-2423651851ee req-86c1a6ed-e5d1-48d3-9222-b9d017ee10d6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:34.835510 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-6030be51-1111-45c4-b681-2423651851ee req-86c1a6ed-e5d1-48d3-9222-b9d017ee10d6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:34.839651 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:34.849738 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-6030be51-1111-45c4-b681-2423651851ee req-86c1a6ed-e5d1-48d3-9222-b9d017ee10d6 service nova] Creating event network-changed:7449e4d4-a7d1-4de2-8f16-14140f4f8f07 for instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd on hv-cinder-79760 Jul 18 14:31:34.856668 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-6030be51-1111-45c4-b681-2423651851ee req-86c1a6ed-e5d1-48d3-9222-b9d017ee10d6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118992 Jul 18 14:31:34.857917 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 566/1123] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:35.479150 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:35.480242 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:35.488409 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:35.488873 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:35.489687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:35.490112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:35.623630 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:35.624338 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:35.632538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:35.632991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:35.634527 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:35.635003 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:35.651932 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:35.660037 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-02539432-a6ee-4114-a8a1-1e0ce95d035e tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.185983 Jul 18 14:31:35.661691 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 558/1124] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:35 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:35.839189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:35.847341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9026455e-d8ec-4f80-81b8-33c92a16cef1 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.230024 Jul 18 14:31:35.848078 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 567/1125] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:35 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:36.678605 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:36.679169 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:36.686179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:36.686620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:36.687380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:36.687807 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:36.864958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:36.865600 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:36.872620 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:36.873074 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:36.873899 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:36.874334 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:36.890236 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:36.899401 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-135d7421-43cb-4e2f-8452-af366f8a7f2b tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1575 microversion: 2.1 time: 0.224604 Jul 18 14:31:36.900209 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 559/1126] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:36 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1575 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:37.080413 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:37.094732 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-e2bab3de-a962-425e-9f4f-a630fc88e8c4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.233654 Jul 18 14:31:37.095328 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 568/1127] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:36 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:37.917537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:37.918315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:37.925077 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:37.925521 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:37.926314 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:37.926746 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:38.075386 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:38.083168 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c4c0463c-a644-4f11-8966-53b3b0340eb2 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1562 microversion: 2.1 time: 0.169838 Jul 18 14:31:38.083736 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 560/1128] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:37 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:38.112838 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:38.113714 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:38.121105 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:38.121559 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:38.122369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:38.122810 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:38.277018 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:38.284640 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9a3479bd-9369-492d-bb31-ba058a2d7e2c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.176285 Jul 18 14:31:38.285213 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 569/1129] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:38 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:39.250805 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-10e917dc-9649-47fc-b04c-1eb5002367fd req-e67e0c62-3eb6-4d59-8534-36f324687b89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "name": "network-vif-plugged", "status": "completed", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:39.262260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-10e917dc-9649-47fc-b04c-1eb5002367fd req-e67e0c62-3eb6-4d59-8534-36f324687b89 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:39.262740 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-10e917dc-9649-47fc-b04c-1eb5002367fd req-e67e0c62-3eb6-4d59-8534-36f324687b89 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:39.275445 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-10e917dc-9649-47fc-b04c-1eb5002367fd req-e67e0c62-3eb6-4d59-8534-36f324687b89 service nova] Creating event network-vif-plugged:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:31:39.280819 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-10e917dc-9649-47fc-b04c-1eb5002367fd req-e67e0c62-3eb6-4d59-8534-36f324687b89 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033773 Jul 18 14:31:39.281504 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 561/1130] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:39.305852 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:39.306972 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:39.318549 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:39.319205 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:39.320572 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:39.321341 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:39.480624 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:39.488947 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-39ebff80-9e67-4222-a0b1-335d83cd9737 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.190354 Jul 18 14:31:39.489674 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 570/1131] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:39 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:40.509733 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:40.510516 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:40.520385 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:40.520893 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:40.521951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:40.522546 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:40.678699 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:40.686370 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c6086a62-c635-473e-bbe1-9e0b8bd5034b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.182921 Jul 18 14:31:40.686930 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 562/1132] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:40 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:41.709184 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:41.710171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:41.718277 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:41.718804 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:41.719572 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:41.720040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:41.878204 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:41.886007 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7cce201f-95af-4978-b1bc-caa9036602d3 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.182907 Jul 18 14:31:41.886642 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 571/1133] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:41 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:42.903107 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:42.903687 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:42.906141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:42.906795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=53 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:42.912697 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:42.913151 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:42.913954 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:42.914398 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:43.054215 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:43.066673 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-f668657b-b6c6-422e-8be2-1452919fe89d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.167178 Jul 18 14:31:43.067559 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 563/1134] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:42 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:44.084845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:44.085440 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:44.087546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:44.088226 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=6 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:44.089594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:31:44.096298 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:44.096754 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:44.097538 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:44.098009 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:44.242024 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:44.249680 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7716e46e-c734-4a56-a5d4-4586981fe8e7 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.168813 Jul 18 14:31:44.250274 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 572/1135] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:44 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:45.266626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:45.267232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:45.268787 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-9b123ff4-7cb9-40ce-921f-5e4a60ca5aab req-f5d1e59e-47ec-4b2d-89be-e30402e272d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cb30d8-74b9-41d3-be99-830cdb43c8dd", "name": "network-vif-plugged", "status": "completed", "tag": "7449e4d4-a7d1-4de2-8f16-14140f4f8f07"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:45.273740 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:45.274141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:45.274959 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:45.275387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:45.279281 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-9b123ff4-7cb9-40ce-921f-5e4a60ca5aab req-f5d1e59e-47ec-4b2d-89be-e30402e272d8 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:45.279840 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-9b123ff4-7cb9-40ce-921f-5e4a60ca5aab req-f5d1e59e-47ec-4b2d-89be-e30402e272d8 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:45.297376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-9b123ff4-7cb9-40ce-921f-5e4a60ca5aab req-f5d1e59e-47ec-4b2d-89be-e30402e272d8 service nova] Creating event network-vif-plugged:7449e4d4-a7d1-4de2-8f16-14140f4f8f07 for instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd on hv-cinder-79760 Jul 18 14:31:45.302663 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-9b123ff4-7cb9-40ce-921f-5e4a60ca5aab req-f5d1e59e-47ec-4b2d-89be-e30402e272d8 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037679 Jul 18 14:31:45.303655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 573/1136] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:31:45.428712 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:45.436918 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c4dd47af-b8b5-4fa4-a76c-63733aca3a07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.174676 Jul 18 14:31:45.437496 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 564/1137] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:45 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:46.456117 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:46.456764 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:46.464596 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:46.465049 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:46.466064 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:46.466487 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:46.620299 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:46.632308 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-77df9b2e-dfb4-486f-9503-48b957f41dac tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1267 microversion: 2.1 time: 0.181748 Jul 18 14:31:46.632958 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 574/1138] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:46 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1267 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:47.655574 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:47.656186 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:47.665402 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.665901 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:47.666705 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.667130 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:47.814831 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:47.825834 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-5bad472a-3b68-40ce-a84e-9faa971f40f9 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1455 microversion: 2.1 time: 0.176064 Jul 18 14:31:47.826560 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 565/1139] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:47 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1455 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:47.846197 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:31:47.846774 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:31:47.853704 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.854175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:47.854937 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:47.855369 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:48.007628 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:31:48.016171 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-856d484e-ddc5-4d84-bb29-431c57a232ca tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1455 microversion: 2.1 time: 0.173854 Jul 18 14:31:48.016748 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 575/1140] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:31:47 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1455 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:31:49.991803 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-af4203e7-56ef-49fe-987d-6a424dcc20b9 req-e7ac6ca3-e877-4873-9ff7-0e5ed9144a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cb30d8-74b9-41d3-be99-830cdb43c8dd", "tag": "7449e4d4-a7d1-4de2-8f16-14140f4f8f07"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:31:50.001533 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-af4203e7-56ef-49fe-987d-6a424dcc20b9 req-e7ac6ca3-e877-4873-9ff7-0e5ed9144a7c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:31:50.002383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-af4203e7-56ef-49fe-987d-6a424dcc20b9 req-e7ac6ca3-e877-4873-9ff7-0e5ed9144a7c service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:31:50.015400 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-af4203e7-56ef-49fe-987d-6a424dcc20b9 req-e7ac6ca3-e877-4873-9ff7-0e5ed9144a7c service nova] Creating event network-changed:7449e4d4-a7d1-4de2-8f16-14140f4f8f07 for instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd on hv-cinder-79760 Jul 18 14:31:50.021187 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-af4203e7-56ef-49fe-987d-6a424dcc20b9 req-e7ac6ca3-e877-4873-9ff7-0e5ed9144a7c service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033053 Jul 18 14:31:50.022038 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 566/1141] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:32:57.917523 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=7 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:57.921136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=7 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:57.922890 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=50 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:57.927344 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:57.927845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:57.930330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=60 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:32:57.936244 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-04f6920f-41c7-405f-a24e-93323762e90b req-4defe5b7-ce2d-452b-a424-31202c6bd9a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:32:57.949305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:57.949790 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:57.950590 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:57.951024 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:57.957927 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-04f6920f-41c7-405f-a24e-93323762e90b req-4defe5b7-ce2d-452b-a424-31202c6bd9a2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:57.958376 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-04f6920f-41c7-405f-a24e-93323762e90b req-4defe5b7-ce2d-452b-a424-31202c6bd9a2 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:57.972536 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-04f6920f-41c7-405f-a24e-93323762e90b req-4defe5b7-ce2d-452b-a424-31202c6bd9a2 service nova] Creating event network-changed:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:32:57.978093 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-04f6920f-41c7-405f-a24e-93323762e90b req-4defe5b7-ce2d-452b-a424-31202c6bd9a2 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058767 Jul 18 14:32:57.978815 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 567/1142] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:32:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:32:57.981209 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Going to try to terminate instance {{(pid=117767) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:32:58.077782 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d7fdadc1-fe16-4676-b5fe-6820867412af tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "DELETE /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 204 len: 0 microversion: 2.1 time: 0.161365 Jul 18 14:32:58.082688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 576/1143] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:32:57 2022] DELETE /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:32:58.088824 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:58.089626 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:58.096115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:58.096880 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:58.098134 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:58.098693 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:58.283343 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:58.292561 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-fd030099-175f-47ae-93b4-d5118feefcd6 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.208039 Jul 18 14:32:58.293147 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 568/1144] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:58 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:32:59.313247 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:32:59.313959 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:32:59.321563 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:59.322046 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:59.322831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:32:59.323269 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:32:59.501820 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:32:59.510106 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-ed870fd5-cb05-4f74-a45d-a4b3156c6bb5 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1568 microversion: 2.1 time: 0.201437 Jul 18 14:32:59.510692 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 577/1145] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:32:59 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1568 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:00.285045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-124f4105-ab42-4f05-96b6-1ab759e6944c req-bb3f14bc-d67d-40d7-87eb-dd86728fe7aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149d386a-8674-4d14-9ff4-25427d71489e", "name": "network-vif-deleted", "tag": "b9f1f726-c327-422a-98de-e1833ed6fadf"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:00.301721 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-124f4105-ab42-4f05-96b6-1ab759e6944c req-bb3f14bc-d67d-40d7-87eb-dd86728fe7aa service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:00.302842 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-124f4105-ab42-4f05-96b6-1ab759e6944c req-bb3f14bc-d67d-40d7-87eb-dd86728fe7aa service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:00.315708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-124f4105-ab42-4f05-96b6-1ab759e6944c req-bb3f14bc-d67d-40d7-87eb-dd86728fe7aa service nova] Creating event network-vif-deleted:b9f1f726-c327-422a-98de-e1833ed6fadf for instance 149d386a-8674-4d14-9ff4-25427d71489e on hv-cinder-79760 Jul 18 14:33:00.321786 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-124f4105-ab42-4f05-96b6-1ab759e6944c req-bb3f14bc-d67d-40d7-87eb-dd86728fe7aa service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042777 Jul 18 14:33:00.322392 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 569/1146] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:33:00.528159 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:00.528774 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:00.536175 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:00.536688 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:00.537474 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:00.537914 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:00.644514 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0b41303f85c7455087c8d25658f1a548', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfe924f59fd34f58b443e1c324dc581c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:00.653682 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9c2e1993-86c3-4eeb-8527-769f1daa4b67 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 200 len: 1218 microversion: 2.1 time: 0.129625 Jul 18 14:33:00.654930 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 578/1147] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:00 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 1218 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:01.672362 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:01.673052 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] [instance: 149d386a-8674-4d14-9ff4-25427d71489e] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:01.679883 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:01.680479 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:01.681367 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:01.681834 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:01.695920 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] HTTP exception thrown: Instance 149d386a-8674-4d14-9ff4-25427d71489e could not be found. Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Request method failure captured: Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e HTTP/1.1 Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1W3-Ca0hLd1pRRvVu9Xs_k7b_W7hCAoHHcA0dlzsoienLUgrMWxh1thJ77E4S_sm88zJ-WQGl7ZBK9tjf3U46UEBSBQVmB6IaB0esWnZ5clxcJr-SoU2f34F0mHJOtGLBXW4yt9b5rmO7d_8gvaJfLkkD7mqh5uDHErgdsi40NRc5wo Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: bfe924f59fd34f58b443e1c324dc581c Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-TestShelveInstance-648855364 Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:33:01.697696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/bfe924f59fd34f58b443e1c324dc581c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bfe924f59fd34f58b443e1c324dc581c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/bfe924f59fd34f58b443e1c324dc581c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_bfe924f59fd34f58b443e1c324dc581c", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-TestShelveInstance-648855364 Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: bfe924f59fd34f58b443e1c324dc581c Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-TestShelveInstance-648855364 Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-TestShelveInstance-648855364-project Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 0b41303f85c7455087c8d25658f1a548 Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-TestShelveInstance-648855364-project Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 149d386a-8674-4d14-9ff4-25427d71489e could not be found. Jul 18 14:33:01.699383 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '149d386a-8674-4d14-9ff4-25427d71489e'} Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149d386a-8674-4d14-9ff4-25427d71489e could not be found. Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:33:01.700260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149d386a-8674-4d14-9ff4-25427d71489e could not be found. Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149d386a-8674-4d14-9ff4-25427d71489e could not be found. Jul 18 14:33:01.701696 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:33:01.702980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Returning 404 to user: Instance 149d386a-8674-4d14-9ff4-25427d71489e could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:33:01.702980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-8e3a204f-2131-40af-8a24-975013684cc9 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e" status: 404 len: 111 microversion: 2.1 time: 0.031625 Jul 18 14:33:01.702980 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 570/1148] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:01 2022] GET /compute/v2.1/servers/149d386a-8674-4d14-9ff4-25427d71489e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:33:01.888816 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d8f91e58-fec7-4fef-b855-766b22c32400 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] Calling method '.version_select at 0x7fb53a34b8b0>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:01.919689 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d8f91e58-fec7-4fef-b855-766b22c32400 tempest-TestShelveInstance-648855364 tempest-TestShelveInstance-648855364-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-373848557" status: 202 len: 0 microversion: 2.1 time: 0.034780 Jul 18 14:33:01.920118 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 579/1149] 10.222.0.71 () {58 vars in 1250 bytes} [Mon Jul 18 14:33:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-373848557 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:33:26.307783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2125977482", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1235874317", "security_groups": [{"name": "tempest-secgroup-smoke-2084505188"}], "block_device_mapping_v2": [{"uuid": "52bb4c7f-ec26-4f7e-b69d-b064a1a1d3f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "987edc6b-a6e7-432a-b5f2-10915c51b659"}]}} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:26.316526 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=8 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:26.317099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=12 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:26.441362 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.network.neutron [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] validate_networks() for [('987edc6b-a6e7-432a-b5f2-10915c51b659', None, None, None, None, None)] {{(pid=117766) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 18 14:33:27.009023 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Flavor limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 18 14:33:27.009455 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Image limits 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 18 14:33:27.009966 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Flavor pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 18 14:33:27.010377 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Image pref 0:0:0 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 18 14:33:27.010795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.virt.hardware [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117766) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 18 14:33:27.020286 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:27.020737 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:27.021537 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:27.022007 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:27.038855 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for project 7a000079ba214fdf934764899139f62d. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 18 14:33:27.043012 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.quota [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Getting quotas for user 7093c86da40243a5a8e50ad0f4cd33bb and project 7a000079ba214fdf934764899139f62d. Resources: {'ram', 'cores', 'instances'} {{(pid=117766) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 18 14:33:27.104061 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Going to run 1 instances... {{(pid=117766) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 18 14:33:27.106202 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='52bb4c7f-ec26-4f7e-b69d-b064a1a1d3f7',volume_size=None,volume_type=None)] {{(pid=117766) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 18 14:33:27.258404 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7cdc9ef3-3e07-4a2b-86d5-3628bd0e43a4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.954544 Jul 18 14:33:27.259045 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 571/1150] 10.222.0.71 () {60 vars in 1146 bytes} [Mon Jul 18 14:33:26 2022] POST /compute/v2.1/servers => generated 406 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 18 14:33:27.269423 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-2d67d220-786c-4084-9780-9f3750eed19c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:27.270034 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-2d67d220-786c-4084-9780-9f3750eed19c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:27.272238 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:27.272892 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:27.330543 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-2d67d220-786c-4084-9780-9f3750eed19c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:27.339888 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-2d67d220-786c-4084-9780-9f3750eed19c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1095 microversion: 2.1 time: 0.074470 Jul 18 14:33:27.340467 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 580/1151] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:27 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 18 14:33:28.358303 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:28.358916 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:28.366053 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:28.366570 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:28.367492 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:28.367923 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:28.435812 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:28.444099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e32b5630-0849-4875-939f-4bbdfe65538b tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1211 microversion: 2.1 time: 0.090376 Jul 18 14:33:28.444785 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 572/1152] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:28 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1211 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:29.461941 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:29.462546 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:29.470330 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:29.471071 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:29.471441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:29.472075 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:29.624424 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:29.637498 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-88a60f60-e4ca-4088-885f-0ebc07bb5172 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.179479 Jul 18 14:33:29.638884 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 581/1153] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:29 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:29.679794 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [req-4b628e8e-49ff-42ed-99b2-3e0e59cf4f44 req-ce82f56b-4a49-4bac-934e-2ae4fc18a218 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a892acf7-41bb-4585-9879-56ef23ebe2de", "tag": "e93fd5ac-6712-4d83-b456-59a6242eb799"}]} {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:29.693863 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-4b628e8e-49ff-42ed-99b2-3e0e59cf4f44 req-ce82f56b-4a49-4bac-934e-2ae4fc18a218 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:29.694229 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [req-4b628e8e-49ff-42ed-99b2-3e0e59cf4f44 req-ce82f56b-4a49-4bac-934e-2ae4fc18a218 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:29.714136 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.compute.server_external_events [req-4b628e8e-49ff-42ed-99b2-3e0e59cf4f44 req-ce82f56b-4a49-4bac-934e-2ae4fc18a218 service nova] Creating event network-changed:e93fd5ac-6712-4d83-b456-59a6242eb799 for instance a892acf7-41bb-4585-9879-56ef23ebe2de on hv-cinder-79760 Jul 18 14:33:29.722127 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [req-4b628e8e-49ff-42ed-99b2-3e0e59cf4f44 req-ce82f56b-4a49-4bac-934e-2ae4fc18a218 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045209 Jul 18 14:33:29.722903 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 573/1154] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:33:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:33:30.656770 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:30.657386 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:30.664660 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:30.665117 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:30.665978 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:30.666412 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:30.802736 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:30.810592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-b0eaf276-3f5f-4109-9743-8bd7478ad281 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.157850 Jul 18 14:33:30.811180 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 582/1155] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:30 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:31.829043 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:31.830260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:31.837174 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:31.837621 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:31.838411 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:31.838836 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:31.991163 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:32.000197 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e2cd7ee1-a1fa-415e-b5c1-2e05988fa76d tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.175518 Jul 18 14:33:32.000742 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 574/1156] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:31 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:33.023723 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:33.024321 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:33.031198 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:33.031646 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:33.032410 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:33.032900 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:33.171472 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:33.179845 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-fa79de16-9f50-4af8-92cf-3f6cff96178e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.160136 Jul 18 14:33:33.180420 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 583/1157] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:33 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:34.197002 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:34.197635 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:34.204767 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:34.205336 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:34.206161 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:34.206595 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:34.354887 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:34.367119 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-12555a5a-f807-4459-9249-d3e0f8a891de tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.173785 Jul 18 14:33:34.367877 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 575/1158] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:34 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:35.387785 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:35.388439 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:35.395778 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:35.396222 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:35.396997 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:35.397431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:35.552208 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:35.564070 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-61b718f3-85e0-4982-bf2d-8a17dc837f35 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.179928 Jul 18 14:33:35.564780 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 584/1159] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:35 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:36.583467 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:36.584115 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:36.601765 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.602235 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.603031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:36.603476 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:36.761528 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:36.773311 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-d6e9e6f2-3ebd-4f6e-9d0e-ceeba5a1d295 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.195018 Jul 18 14:33:36.774099 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 576/1160] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:36 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:37.797699 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:37.798335 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:37.800871 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell0:SELECT=2 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:37.806591 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:37.807040 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:37.807860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:37.808338 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:37.949138 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:37.956979 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-4502a13f-ce34-4e74-bf3a-e390ae10df70 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.164907 Jul 18 14:33:37.957552 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 585/1161] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:37 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:38.974611 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:38.975223 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:38.977332 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=2 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:38.978038 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell0:SELECT=6 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:33:38.985851 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:38.986311 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:38.987103 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:38.987553 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:39.131474 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:39.141387 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-4a313abb-376f-40d1-ae2b-fdf0a7260c67 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.170903 Jul 18 14:33:39.141967 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 577/1162] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:38 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:39.846137 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-696dc678-4da2-403b-a5a1-f4ad29a215cb req-d193ca45-0e81-4865-9510-174b40fcaf1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a892acf7-41bb-4585-9879-56ef23ebe2de", "name": "network-vif-plugged", "status": "completed", "tag": "e93fd5ac-6712-4d83-b456-59a6242eb799"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:39.856295 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-696dc678-4da2-403b-a5a1-f4ad29a215cb req-d193ca45-0e81-4865-9510-174b40fcaf1f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:39.856739 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-696dc678-4da2-403b-a5a1-f4ad29a215cb req-d193ca45-0e81-4865-9510-174b40fcaf1f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:39.872481 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-696dc678-4da2-403b-a5a1-f4ad29a215cb req-d193ca45-0e81-4865-9510-174b40fcaf1f service nova] Creating event network-vif-plugged:e93fd5ac-6712-4d83-b456-59a6242eb799 for instance a892acf7-41bb-4585-9879-56ef23ebe2de on hv-cinder-79760 Jul 18 14:33:39.879031 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-696dc678-4da2-403b-a5a1-f4ad29a215cb req-d193ca45-0e81-4865-9510-174b40fcaf1f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036499 Jul 18 14:33:39.880203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 586/1163] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:33:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:33:40.159423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:40.160019 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:40.166840 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:40.167293 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:40.168094 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:40.168527 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:40.327972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:40.336718 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-e2152c26-2000-4b9d-9145-8daf305dfa4a tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1267 microversion: 2.1 time: 0.181378 Jul 18 14:33:40.337315 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 578/1164] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:40 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:41.356556 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:41.357427 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:41.364638 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:41.365021 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:41.365831 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:41.366272 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:41.522441 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:41.530594 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-704600cd-0e49-41ea-a571-d87814591b6f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1454 microversion: 2.1 time: 0.180253 Jul 18 14:33:41.531187 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 587/1165] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:41 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1454 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:41.547285 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:33:41.547854 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:33:41.554490 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:41.554933 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:41.555685 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:41.556112 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:41.709497 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:33:41.718775 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-14922913-8510-4f32-bdb6-6da19b462bbd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1454 microversion: 2.1 time: 0.175415 Jul 18 14:33:41.719338 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 579/1166] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:33:41 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1454 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:33:43.711271 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-e8f53ca0-0742-4b36-9571-34a9089c4419 req-2071badd-2483-4b9b-9797-83cd6a35c0ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a892acf7-41bb-4585-9879-56ef23ebe2de", "tag": "e93fd5ac-6712-4d83-b456-59a6242eb799"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:33:43.720181 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e8f53ca0-0742-4b36-9571-34a9089c4419 req-2071badd-2483-4b9b-9797-83cd6a35c0ba service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:33:43.720622 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-e8f53ca0-0742-4b36-9571-34a9089c4419 req-2071badd-2483-4b9b-9797-83cd6a35c0ba service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:33:43.732350 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-e8f53ca0-0742-4b36-9571-34a9089c4419 req-2071badd-2483-4b9b-9797-83cd6a35c0ba service nova] Creating event network-changed:e93fd5ac-6712-4d83-b456-59a6242eb799 for instance a892acf7-41bb-4585-9879-56ef23ebe2de on hv-cinder-79760 Jul 18 14:33:43.737587 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-e8f53ca0-0742-4b36-9571-34a9089c4419 req-2071badd-2483-4b9b-9797-83cd6a35c0ba service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030066 Jul 18 14:33:43.738200 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 588/1167] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:34:19.116599 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:34:19.117317 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Mon Jul 18 14:34:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:34:23.487491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:34:23.488169 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:34:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:35:11.902584 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:35:11.903418 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG dbcounter [-] [117766] Writing DB stats nova_cell1:SELECT=46 {{(pid=117766) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:35:11.906767 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_api:SELECT=20 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:35:11.907537 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG dbcounter [-] [117767] Writing DB stats nova_cell1:SELECT=40 {{(pid=117767) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 18 14:35:11.908013 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:11.908586 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:11.913839 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-38eb2f19-bc5b-4d94-a208-8c789a6915a9 req-3ebce992-c8e7-49ad-912d-7471c41078d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a892acf7-41bb-4585-9879-56ef23ebe2de", "tag": "e93fd5ac-6712-4d83-b456-59a6242eb799"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:35:11.917492 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:11.918058 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:11.918926 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:11.919426 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:11.925481 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-38eb2f19-bc5b-4d94-a208-8c789a6915a9 req-3ebce992-c8e7-49ad-912d-7471c41078d6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:11.925962 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-38eb2f19-bc5b-4d94-a208-8c789a6915a9 req-3ebce992-c8e7-49ad-912d-7471c41078d6 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:11.939691 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-38eb2f19-bc5b-4d94-a208-8c789a6915a9 req-3ebce992-c8e7-49ad-912d-7471c41078d6 service nova] Creating event network-changed:e93fd5ac-6712-4d83-b456-59a6242eb799 for instance a892acf7-41bb-4585-9879-56ef23ebe2de on hv-cinder-79760 Jul 18 14:35:11.945623 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-38eb2f19-bc5b-4d94-a208-8c789a6915a9 req-3ebce992-c8e7-49ad-912d-7471c41078d6 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041625 Jul 18 14:35:11.947719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 589/1168] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:35:11.950468 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:35:12.064380 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-98f19b1e-c9ea-4919-9813-81f52d4bee4f tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "DELETE /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 204 len: 0 microversion: 2.1 time: 0.161046 Jul 18 14:35:12.066761 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 580/1169] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:35:11 2022] DELETE /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:35:12.076960 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:12.077766 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:12.084719 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:12.085189 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:12.086006 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:12.086545 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:12.378496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:35:12.386521 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-7af189a1-a3f7-4db1-8eb7-6c570dfafdf4 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1579 microversion: 2.1 time: 0.315085 Jul 18 14:35:12.387095 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 590/1170] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:12 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1579 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:35:13.405590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:13.406795 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:13.415529 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:13.415998 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:13.416803 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:13.417246 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:13.618745 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:35:13.626701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-7b8439b9-033e-40de-a627-ac3e3fb15c16 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1579 microversion: 2.1 time: 0.225616 Jul 18 14:35:13.627287 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 581/1171] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:13 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1579 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:35:14.279655 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-fe342621-af65-49d5-bcc3-71375b7cc49c req-d16609e1-6639-40c1-9037-71ee95f6d92f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a892acf7-41bb-4585-9879-56ef23ebe2de", "name": "network-vif-deleted", "tag": "e93fd5ac-6712-4d83-b456-59a6242eb799"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:35:14.289059 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-fe342621-af65-49d5-bcc3-71375b7cc49c req-d16609e1-6639-40c1-9037-71ee95f6d92f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:14.289551 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-fe342621-af65-49d5-bcc3-71375b7cc49c req-d16609e1-6639-40c1-9037-71ee95f6d92f service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:14.302406 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-fe342621-af65-49d5-bcc3-71375b7cc49c req-d16609e1-6639-40c1-9037-71ee95f6d92f service nova] Creating event network-vif-deleted:e93fd5ac-6712-4d83-b456-59a6242eb799 for instance a892acf7-41bb-4585-9879-56ef23ebe2de on hv-cinder-79760 Jul 18 14:35:14.308166 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-fe342621-af65-49d5-bcc3-71375b7cc49c req-d16609e1-6639-40c1-9037-71ee95f6d92f service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032653 Jul 18 14:35:14.308774 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 591/1172] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:35:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:35:14.645461 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:14.646701 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:14.655137 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:14.655590 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:14.656349 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:14.656772 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:14.692802 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:14.693260 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:14.693760 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lazy-loading 'fault' on Instance uuid a892acf7-41bb-4585-9879-56ef23ebe2de {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:35:14.738031 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:35:14.746775 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-12b19562-5c0a-461f-9789-5329799fad3e tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 200 len: 1231 microversion: 2.1 time: 0.105890 Jul 18 14:35:14.747348 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 582/1173] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:14 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 1231 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:35:15.765433 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:15.766102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: a892acf7-41bb-4585-9879-56ef23ebe2de] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:15.773142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:15.773592 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:15.774408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:15.774843 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:15.789079 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] HTTP exception thrown: Instance a892acf7-41bb-4585-9879-56ef23ebe2de could not be found. Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Request method failure captured: Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de HTTP/1.1 Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1W4VyTYKx33l7YQU41bg9PNNcOKpVC3B2c31QVMv2X7KYVZvkQ2YVcNk6zjVSBkkIV0CmMM3WZk5-BnPRZMghX9ofF1XAw--x_JdJqng_w1NKXl1JrW9W779HQRy3ZJAJVbzYn2rkz1zD3yThGiig0-E_0grvaKMI5jlt5-mm9RAmUU Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:35:15.790791 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7a000079ba214fdf934764899139f62d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7a000079ba214fdf934764899139f62d", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 7093c86da40243a5a8e50ad0f4cd33bb Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance a892acf7-41bb-4585-9879-56ef23ebe2de could not be found. Jul 18 14:35:15.792713 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': 'a892acf7-41bb-4585-9879-56ef23ebe2de'} Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a892acf7-41bb-4585-9879-56ef23ebe2de could not be found. Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:35:15.793860 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a892acf7-41bb-4585-9879-56ef23ebe2de could not be found. Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a892acf7-41bb-4585-9879-56ef23ebe2de could not be found. Jul 18 14:35:15.795558 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:15.797065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Returning 404 to user: Instance a892acf7-41bb-4585-9879-56ef23ebe2de could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:35:15.797065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-d1632deb-2b01-4ff0-be42-c1c8e2e7bd07 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de" status: 404 len: 111 microversion: 2.1 time: 0.031706 Jul 18 14:35:15.797065 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 592/1174] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:15 2022] GET /compute/v2.1/servers/a892acf7-41bb-4585-9879-56ef23ebe2de => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:35:18.984869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:18.986276 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:18.988841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-a34525e5-e7f7-453e-8f5b-84cd1104b97d req-e5dc982f-b6a8-4f49-867a-0853499789ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "26cb30d8-74b9-41d3-be99-830cdb43c8dd", "tag": "7449e4d4-a7d1-4de2-8f16-14140f4f8f07"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:35:18.994656 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:18.995114 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:18.995951 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:18.996389 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:18.999013 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a34525e5-e7f7-453e-8f5b-84cd1104b97d req-e5dc982f-b6a8-4f49-867a-0853499789ba service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:18.999615 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-a34525e5-e7f7-453e-8f5b-84cd1104b97d req-e5dc982f-b6a8-4f49-867a-0853499789ba service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:19.013028 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-a34525e5-e7f7-453e-8f5b-84cd1104b97d req-e5dc982f-b6a8-4f49-867a-0853499789ba service nova] Creating event network-changed:7449e4d4-a7d1-4de2-8f16-14140f4f8f07 for instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd on hv-cinder-79760 Jul 18 14:35:19.021864 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-a34525e5-e7f7-453e-8f5b-84cd1104b97d req-e5dc982f-b6a8-4f49-867a-0853499789ba service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037332 Jul 18 14:35:19.022741 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 593/1175] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 18 14:35:19.028848 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Going to try to terminate instance {{(pid=117766) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 18 14:35:19.144432 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-baaf0e1b-83d3-4664-a28e-d77c5c8a2827 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "DELETE /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 204 len: 0 microversion: 2.1 time: 0.163467 Jul 18 14:35:19.147828 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 583/1176] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:35:18 2022] DELETE /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 18 14:35:19.155318 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:19.157016 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:19.163765 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:19.164601 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:19.165930 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:19.166644 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:19.332452 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.policy [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117767) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:35:19.341820 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-be014a0d-c424-4240-b11f-53e462822baa tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1580 microversion: 2.1 time: 0.190990 Jul 18 14:35:19.342491 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 594/1177] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:19 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1580 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:35:20.362232 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:20.362979 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:20.371141 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:20.371671 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:20.372423 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:20.372869 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:20.580408 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:35:20.589780 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-06404f3d-4ce1-4277-b39e-7b40eb5ee377 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1580 microversion: 2.1 time: 0.232879 Jul 18 14:35:20.590513 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 584/1178] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:20 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1580 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:35:21.312061 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [req-af973815-9827-4a18-bced-cf7050ee1534 req-97bd1b2e-3514-4771-a558-aad82be28742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "26cb30d8-74b9-41d3-be99-830cdb43c8dd", "name": "network-vif-deleted", "tag": "7449e4d4-a7d1-4de2-8f16-14140f4f8f07"}]} {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 18 14:35:21.326976 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-af973815-9827-4a18-bced-cf7050ee1534 req-97bd1b2e-3514-4771-a558-aad82be28742 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:21.327460 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [req-af973815-9827-4a18-bced-cf7050ee1534 req-97bd1b2e-3514-4771-a558-aad82be28742 service nova] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:21.343431 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.compute.server_external_events [req-af973815-9827-4a18-bced-cf7050ee1534 req-97bd1b2e-3514-4771-a558-aad82be28742 service nova] Creating event network-vif-deleted:7449e4d4-a7d1-4de2-8f16-14140f4f8f07 for instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd on hv-cinder-79760 Jul 18 14:35:21.349408 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [req-af973815-9827-4a18-bced-cf7050ee1534 req-97bd1b2e-3514-4771-a558-aad82be28742 service nova] 10.222.0.71 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043671 Jul 18 14:35:21.350310 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 595/1179] 10.222.0.71 () {64 vars in 1317 bytes} [Mon Jul 18 14:35:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 18 14:35:21.609644 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:21.611338 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:21.619751 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:21.620748 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:21.621939 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:21.622540 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:21.662882 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:21.663446 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:21.664048 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.objects.instance [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lazy-loading 'fault' on Instance uuid 26cb30d8-74b9-41d3-be99-830cdb43c8dd {{(pid=117766) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 18 14:35:21.708919 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.policy [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7093c86da40243a5a8e50ad0f4cd33bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a000079ba214fdf934764899139f62d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117766) authorize /opt/stack/nova/nova/policy.py:199}} Jul 18 14:35:21.718004 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-c4fd04c3-a735-43c1-b32c-6724912debad tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 200 len: 1231 microversion: 2.1 time: 0.113718 Jul 18 14:35:21.719030 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 585/1180] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:21 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 18 14:35:22.739163 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:22.739934 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 26cb30d8-74b9-41d3-be99-830cdb43c8dd] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:22.747263 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:22.747716 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:22.748496 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:22.748921 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:22.764397 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] HTTP exception thrown: Instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd could not be found. Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Request method failure captured: Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd HTTP/1.1 Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1W4VyTYKx33l7YQU41bg9PNNcOKpVC3B2c31QVMv2X7KYVZvkQ2YVcNk6zjVSBkkIV0CmMM3WZk5-BnPRZMghX9ofF1XAw--x_JdJqng_w1NKXl1JrW9W779HQRy3ZJAJVbzYn2rkz1zD3yThGiig0-E_0grvaKMI5jlt5-mm9RAmUU Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:35:22.766142 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7a000079ba214fdf934764899139f62d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7a000079ba214fdf934764899139f62d", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 7093c86da40243a5a8e50ad0f4cd33bb Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd could not be found. Jul 18 14:35:22.768027 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '26cb30d8-74b9-41d3-be99-830cdb43c8dd'} Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd could not be found. Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:35:22.769102 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd could not be found. Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd could not be found. Jul 18 14:35:22.770985 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:22.772673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Returning 404 to user: Instance 26cb30d8-74b9-41d3-be99-830cdb43c8dd could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:35:22.772673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-9393ca58-2dd8-4056-8b0b-eb1a6ded7f5c tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd" status: 404 len: 111 microversion: 2.1 time: 0.034572 Jul 18 14:35:22.772673 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 596/1181] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:22 2022] GET /compute/v2.1/servers/26cb30d8-74b9-41d3-be99-830cdb43c8dd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:35:23.287969 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:23.288589 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.compute.api [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117766) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:23.296179 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:23.296620 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:23.297449 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:23.297925 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG oslo_concurrency.lockutils [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117766) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:23.313961 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.wsgi [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] HTTP exception thrown: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Request method failure captured: Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: request: DELETE /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da HTTP/1.1 Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept: application/json Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Accept-Encoding: identity Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Connection: close Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Length: 0 Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Content-Type: application/json Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Host: 10.222.0.71 Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Openstack-System-Scope: None Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: User-Agent: python-urllib3/1.26.9 Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Auth-Token: gAAAAABi1W4VyTYKx33l7YQU41bg9PNNcOKpVC3B2c31QVMv2X7KYVZvkQ2YVcNk6zjVSBkkIV0CmMM3WZk5-BnPRZMghX9ofF1XAw--x_JdJqng_w1NKXl1JrW9W779HQRy3ZJAJVbzYn2rkz1zD3yThGiig0-E_0grvaKMI5jlt5-mm9RAmUU Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Id: None Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Domain-Name: None Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Identity-Status: Confirmed Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Is-Admin-Project: True Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Id: default Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Domain-Name: Default Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Project-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Role: reader,member Jul 18 14:35:23.315727 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Roles: reader,member Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7a000079ba214fdf934764899139f62d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7a000079ba214fdf934764899139f62d", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-Tenant-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Id: default Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Domain-Name: Default Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Id: 7093c86da40243a5a8e50ad0f4cd33bb Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: X-User-Name: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: method: > Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: exception: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.317374 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: action_args: {'id': '6a28d78c-fdaf-4772-bcbb-30e790b003da'} Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:35:23.318278 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.319768 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.321131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Returning 404 to user: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. {{(pid=117766) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:35:23.321131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-16960196-f939-44e2-944a-8e0423f73815 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "DELETE /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 404 len: 111 microversion: 2.1 time: 0.034599 Jul 18 14:35:23.321131 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 586/1182] 10.222.0.71 () {58 vars in 1238 bytes} [Mon Jul 18 14:35:23 2022] DELETE /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:35:23.326841 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '>' {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:23.327448 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.compute.api [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] [instance: 6a28d78c-fdaf-4772-bcbb-30e790b003da] Fetching instance by UUID {{(pid=117767) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 18 14:35:23.334671 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:23.335116 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:23.335872 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 18 14:35:23.336299 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG oslo_concurrency.lockutils [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Lock "31d09de4-139b-4035-8793-feb7f7782efc" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117767) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 18 14:35:23.350553 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.wsgi [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] HTTP exception thrown: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Request method failure captured: Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: request: GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da HTTP/1.1 Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept: application/json Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Accept-Encoding: identity Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Connection: close Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Length: 0 Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Content-Type: application/json Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Host: 10.222.0.71 Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Openstack-System-Scope: None Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: User-Agent: python-urllib3/1.26.9 Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Auth-Token: gAAAAABi1W4VyTYKx33l7YQU41bg9PNNcOKpVC3B2c31QVMv2X7KYVZvkQ2YVcNk6zjVSBkkIV0CmMM3WZk5-BnPRZMghX9ofF1XAw--x_JdJqng_w1NKXl1JrW9W779HQRy3ZJAJVbzYn2rkz1zD3yThGiig0-E_0grvaKMI5jlt5-mm9RAmUU Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Id: None Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Domain-Name: None Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Identity-Status: Confirmed Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Is-Admin-Project: True Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Id: default Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Domain-Name: Default Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Project-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Role: reader,member Jul 18 14:35:23.352134 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Roles: reader,member Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/compute/v2/7a000079ba214fdf934764899139f62d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/volume/v3/7a000079ba214fdf934764899139f62d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:8080/v1/AUTH_7a000079ba214fdf934764899139f62d", "adminURL": "http://10.222.0.71:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.71/placement"}]}] Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Id: 7a000079ba214fdf934764899139f62d Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-Tenant-Name: tempest-TestVolumeBootPattern-23737218 Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Id: default Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Domain-Name: Default Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Id: 7093c86da40243a5a8e50ad0f4cd33bb Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: X-User-Name: tempest-TestVolumeBootPattern-23737218-project Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: method: > Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: exception: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.354128 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: action_args: {'id': '6a28d78c-fdaf-4772-bcbb-30e790b003da'} Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: {{(pid=117767) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 18 14:35:23.355305 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. Jul 18 14:35:23.356919 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: ERROR nova.api.openstack.wsgi Jul 18 14:35:23.358612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: DEBUG nova.api.openstack.wsgi [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Returning 404 to user: Instance 6a28d78c-fdaf-4772-bcbb-30e790b003da could not be found. {{(pid=117767) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 18 14:35:23.358612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO nova.api.openstack.requestlog [None req-bcd3e545-1835-4c3a-9414-ff0e4970cbdd tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jul 18 14:35:23.358612 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: [pid: 117767|app: 0|req: 597/1183] 10.222.0.71 () {58 vars in 1235 bytes} [Mon Jul 18 14:35:23 2022] GET /compute/v2.1/servers/6a28d78c-fdaf-4772-bcbb-30e790b003da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 18 14:35:24.699752 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: DEBUG nova.api.openstack.wsgi [None req-b63c20e6-c4ec-4890-9766-d26a84b4f462 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] Calling method '.version_select at 0x7fb53a204700>' {{(pid=117766) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 18 14:35:24.728097 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO nova.api.openstack.requestlog [None req-b63c20e6-c4ec-4890-9766-d26a84b4f462 tempest-TestVolumeBootPattern-23737218 tempest-TestVolumeBootPattern-23737218-project] 10.222.0.71 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1235874317" status: 202 len: 0 microversion: 2.1 time: 0.032740 Jul 18 14:35:24.732972 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: [pid: 117766|app: 0|req: 587/1184] 10.222.0.71 () {58 vars in 1262 bytes} [Mon Jul 18 14:35:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1235874317 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 18 14:36:04.919004 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:36:04.919650 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:36:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:36:08.378122 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:36:08.378783 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Mon Jul 18 14:36:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:37:43.497322 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:37:43.498110 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:37:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:38:01.921991 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:38:01.922694 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:38:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:38:04.826363 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:38:04.827394 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Mon Jul 18 14:38:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:39:24.928203 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:39:24.928796 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:39:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:39:28.389330 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:39:28.390294 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Mon Jul 18 14:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:40:59.132790 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:40:59.133708 dv-cinder-797608-58-iscsi devstack@n-api.service[117766]: Mon Jul 18 14:40:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 18 14:41:03.509376 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 18 14:41:03.510054 dv-cinder-797608-58-iscsi devstack@n-api.service[117767]: Mon Jul 18 14:41:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!